2026-03-28 12:05:04 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 12:05:04 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 12:05:04 [auto1.it] INFO: Batch mode enabled: batch 2/2
2026-03-28 12:05:04 [auto1.it] INFO: Starting spider auto1.it
2026-03-28 12:05:04 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 12:05:04 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 12:05:04 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 12:05:04 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 12:05:04 [scrapy.extensions.telnet] INFO: Telnet Password: b24a69288dbeb512
2026-03-28 12:05:04 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-28 12:05:04 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.it/task_23_2026-03-28T12_05_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-28 12:05:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 12:05:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 12:05:04 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 12:05:04 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 12:05:04 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 12:05:04 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-28 12:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 12:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-28 12:05:05 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 12:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 12:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:05 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 12:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 12:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 12:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 12:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 12:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 12:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 12:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 12:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 12:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 12:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 12:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 12:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 12:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 12:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 12:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 12:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 12:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 12:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 12:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 12:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 12:05:05 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 12:05:05 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 12:05:05 [scrapy.core.engine] INFO: Spider opened
2026-03-28 12:05:05 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 12:05:05 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2026-03-28 12:05:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-28 12:05:05 [scrapy-playwright] INFO: Starting download handler
2026-03-28 12:05:05 [scrapy-playwright] INFO: Starting download handler
2026-03-28 12:05:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-28 12:05:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-28 12:05:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-28 12:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-28 12:05:14 [auto1.it] INFO: Channel: 24h | Page: 0 | totalHits: 3673 | hits on page: 40
2026-03-28 12:05:14 [auto1.it] INFO: Found listing with ID: KS37590
2026-03-28 12:05:14 [auto1.it] INFO: Found listing with ID: SN56705
2026-03-28 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN56705%27 HTTP/1.1" 200 None
2026-03-28 12:05:14 [auto1.it] INFO: Scrape type for SN56705: 1
2026-03-28 12:05:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:14 [auto1.it] INFO: Found listing with ID: RK00703
2026-03-28 12:05:14 [auto1.it] INFO: Found listing with ID: KM72059
2026-03-28 12:05:14 [auto1.it] INFO: Found listing with ID: NL56799
2026-03-28 12:05:14 [auto1.it] INFO: Found listing with ID: CZ11346
2026-03-28 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ11346%27 HTTP/1.1" 200 None
2026-03-28 12:05:14 [auto1.it] INFO: Scrape type for CZ11346: 2
2026-03-28 12:05:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e5beb21-5654-503b-a914-2b1cae75b99a with identifier: CZ11346
2026-03-28 12:05:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e5beb21-5654-503b-a914-2b1cae75b99a with scrape type 2
2026-03-28 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e5beb21-5654-503b-a914-2b1cae75b99a with scrape type 2
2026-03-28 12:05:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3e5beb21-5654-503b-a914-2b1cae75b99a, identifier: CZ11346
2026-03-28 12:05:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3e5beb21-5654-503b-a914-2b1cae75b99a with identifier: CZ11346
2026-03-28 12:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:05:14 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-28 12:05:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:05:14 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-28 12:05:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3e5beb21-5654-503b-a914-2b1cae75b99a with identifier: CZ11346
2026-03-28 12:05:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3e5beb21-5654-503b-a914-2b1cae75b99a with identifier: CZ11346 to the API
2026-03-28 12:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:24:34Z',
 'fuel_type': 'diesel',
 'id': '3e5beb21-5654-503b-a914-2b1cae75b99a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ11346',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 161122,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-14',
 'seller_name': None,
 'title': 'Seat Leon 1.6 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2018}
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ11346%27 HTTP/1.1" 200 None
2026-03-28 12:05:15 [auto1.it] INFO: Saving data for CZ11346: {'auction_closing_time': 1774884274.0, 'created_time': 1774343220.210279, 'last_price_update_time': 1774699515.074836}
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CZ11346') HTTP/1.1" 204 0
2026-03-28 12:05:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:15 [auto1.it] INFO: Found listing with ID: ZV36877
2026-03-28 12:05:15 [auto1.it] INFO: Found listing with ID: AW40388
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW40388%27 HTTP/1.1" 200 None
2026-03-28 12:05:15 [auto1.it] INFO: Scrape type for AW40388: 2
2026-03-28 12:05:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80460fdc-6272-5d55-8b9d-e43980ef5352 with identifier: AW40388
2026-03-28 12:05:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80460fdc-6272-5d55-8b9d-e43980ef5352 with scrape type 2
2026-03-28 12:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80460fdc-6272-5d55-8b9d-e43980ef5352 with scrape type 2
2026-03-28 12:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 80460fdc-6272-5d55-8b9d-e43980ef5352, identifier: AW40388
2026-03-28 12:05:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 80460fdc-6272-5d55-8b9d-e43980ef5352 with identifier: AW40388
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-28 12:05:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-28 12:05:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 80460fdc-6272-5d55-8b9d-e43980ef5352 with identifier: AW40388
2026-03-28 12:05:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 80460fdc-6272-5d55-8b9d-e43980ef5352 with identifier: AW40388 to the API
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:42:20Z',
 'fuel_type': 'petrol',
 'id': '80460fdc-6272-5d55-8b9d-e43980ef5352',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW40388',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 80400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-17',
 'seller_name': None,
 'title': 'Hyundai i20 1.4 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW40388%27 HTTP/1.1" 200 None
2026-03-28 12:05:15 [auto1.it] INFO: Saving data for AW40388: {'auction_closing_time': 1774885340.0, 'created_time': 1773134307.451154, 'last_price_update_time': 1774699515.811467}
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AW40388') HTTP/1.1" 204 0
2026-03-28 12:05:15 [auto1.it] INFO: Found listing with ID: UR17084
2026-03-28 12:05:15 [auto1.it] INFO: Found listing with ID: DE71304
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE71304%27 HTTP/1.1" 200 None
2026-03-28 12:05:15 [auto1.it] INFO: Scrape type for DE71304: 2
2026-03-28 12:05:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fc66b56-8239-5938-8e7b-f902a1605208 with identifier: DE71304
2026-03-28 12:05:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fc66b56-8239-5938-8e7b-f902a1605208 with scrape type 2
2026-03-28 12:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fc66b56-8239-5938-8e7b-f902a1605208 with scrape type 2
2026-03-28 12:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5fc66b56-8239-5938-8e7b-f902a1605208, identifier: DE71304
2026-03-28 12:05:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5fc66b56-8239-5938-8e7b-f902a1605208 with identifier: DE71304
2026-03-28 12:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 12:05:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5fc66b56-8239-5938-8e7b-f902a1605208 with identifier: DE71304
2026-03-28 12:05:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5fc66b56-8239-5938-8e7b-f902a1605208 with identifier: DE71304 to the API
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:08:04Z',
 'fuel_type': 'diesel',
 'id': '5fc66b56-8239-5938-8e7b-f902a1605208',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE71304',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 305596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-21',
 'seller_name': None,
 'title': 'Volvo V60 1.6 D Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2014}
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE71304%27 HTTP/1.1" 200 None
2026-03-28 12:05:16 [auto1.it] INFO: Saving data for DE71304: {'auction_closing_time': 1774883284.0, 'created_time': 1774343231.181223, 'last_price_update_time': 1774699516.390548}
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DE71304') HTTP/1.1" 204 0
2026-03-28 12:05:16 [auto1.it] INFO: Found listing with ID: LA00570
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA00570%27 HTTP/1.1" 200 None
2026-03-28 12:05:16 [auto1.it] INFO: Scrape type for LA00570: 1
2026-03-28 12:05:16 [auto1.it] INFO: Found listing with ID: ST97650
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST97650%27 HTTP/1.1" 200 None
2026-03-28 12:05:16 [auto1.it] INFO: Scrape type for ST97650: 2
2026-03-28 12:05:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5f9bc66-64df-5ac5-9e3d-f54ea593e770 with identifier: ST97650
2026-03-28 12:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5f9bc66-64df-5ac5-9e3d-f54ea593e770 with scrape type 2
2026-03-28 12:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5f9bc66-64df-5ac5-9e3d-f54ea593e770 with scrape type 2
2026-03-28 12:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e5f9bc66-64df-5ac5-9e3d-f54ea593e770, identifier: ST97650
2026-03-28 12:05:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e5f9bc66-64df-5ac5-9e3d-f54ea593e770 with identifier: ST97650
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 12:05:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e5f9bc66-64df-5ac5-9e3d-f54ea593e770 with identifier: ST97650
2026-03-28 12:05:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e5f9bc66-64df-5ac5-9e3d-f54ea593e770 with identifier: ST97650 to the API
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:59:58Z',
 'fuel_type': 'diesel',
 'id': 'e5f9bc66-64df-5ac5-9e3d-f54ea593e770',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST97650',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 205873,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-10',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2013}
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST97650%27 HTTP/1.1" 200 None
2026-03-28 12:05:16 [auto1.it] INFO: Saving data for ST97650: {'auction_closing_time': 1774886398.0, 'created_time': 1773241902.921045, 'last_price_update_time': 1774699516.965003}
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ST97650') HTTP/1.1" 204 0
2026-03-28 12:05:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:17 [auto1.it] INFO: Found listing with ID: CD54959
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD54959%27 HTTP/1.1" 200 None
2026-03-28 12:05:17 [auto1.it] INFO: Scrape type for CD54959: 2
2026-03-28 12:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4f7e7ed-7a10-5e68-bebd-36b5adf5d8f5 with identifier: CD54959
2026-03-28 12:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4f7e7ed-7a10-5e68-bebd-36b5adf5d8f5 with scrape type 2
2026-03-28 12:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4f7e7ed-7a10-5e68-bebd-36b5adf5d8f5 with scrape type 2
2026-03-28 12:05:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b4f7e7ed-7a10-5e68-bebd-36b5adf5d8f5, identifier: CD54959
2026-03-28 12:05:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b4f7e7ed-7a10-5e68-bebd-36b5adf5d8f5 with identifier: CD54959
2026-03-28 12:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b4f7e7ed-7a10-5e68-bebd-36b5adf5d8f5 with identifier: CD54959
2026-03-28 12:05:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b4f7e7ed-7a10-5e68-bebd-36b5adf5d8f5 with identifier: CD54959 to the API
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:33:25Z',
 'fuel_type': 'diesel',
 'id': 'b4f7e7ed-7a10-5e68-bebd-36b5adf5d8f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD54959',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 159839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-11',
 'seller_name': None,
 'title': 'Opel Mokka 1.7 CDTI Cosmo ecoFlex',
 'transmission': 'manual',
 'trim': 'Cosmo ecoFlex',
 'year': 2015}
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD54959%27 HTTP/1.1" 200 None
2026-03-28 12:05:17 [auto1.it] INFO: Saving data for CD54959: {'auction_closing_time': 1774884805.0, 'created_time': 1773824773.404386, 'last_price_update_time': 1774699517.506039}
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CD54959') HTTP/1.1" 204 0
2026-03-28 12:05:17 [auto1.it] INFO: Found listing with ID: ZH08694
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH08694%27 HTTP/1.1" 200 None
2026-03-28 12:05:17 [auto1.it] INFO: Scrape type for ZH08694: 1
2026-03-28 12:05:17 [auto1.it] INFO: Found listing with ID: WN91380
2026-03-28 12:05:17 [auto1.it] INFO: Found listing with ID: RT10721
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT10721%27 HTTP/1.1" 200 None
2026-03-28 12:05:17 [auto1.it] INFO: Scrape type for RT10721: 1
2026-03-28 12:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:17 [auto1.it] INFO: Found listing with ID: XL68174
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL68174%27 HTTP/1.1" 200 None
2026-03-28 12:05:17 [auto1.it] INFO: Scrape type for XL68174: 2
2026-03-28 12:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0eb50f97-3888-55ed-a6c5-16cf0b0679e9 with identifier: XL68174
2026-03-28 12:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0eb50f97-3888-55ed-a6c5-16cf0b0679e9 with scrape type 2
2026-03-28 12:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0eb50f97-3888-55ed-a6c5-16cf0b0679e9 with scrape type 2
2026-03-28 12:05:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0eb50f97-3888-55ed-a6c5-16cf0b0679e9, identifier: XL68174
2026-03-28 12:05:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0eb50f97-3888-55ed-a6c5-16cf0b0679e9 with identifier: XL68174
2026-03-28 12:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0eb50f97-3888-55ed-a6c5-16cf0b0679e9 with identifier: XL68174
2026-03-28 12:05:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0eb50f97-3888-55ed-a6c5-16cf0b0679e9 with identifier: XL68174 to the API
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 354,
 'expiration_date': '2026-03-30T15:35:01Z',
 'fuel_type': 'petrol',
 'id': '0eb50f97-3888-55ed-a6c5-16cf0b0679e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL68174',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 123890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-30',
 'seller_name': None,
 'title': 'Porsche Macan S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL68174%27 HTTP/1.1" 200 None
2026-03-28 12:05:18 [auto1.it] INFO: Saving data for XL68174: {'auction_closing_time': 1774884901.0, 'created_time': 1773836628.120266, 'last_price_update_time': 1774699518.038079}
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XL68174') HTTP/1.1" 204 0
2026-03-28 12:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: NR40821
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: NR41367
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: DS09954
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: EF37813
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: CJ77239
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CJ77239%27 HTTP/1.1" 200 None
2026-03-28 12:05:18 [auto1.it] INFO: Scrape type for CJ77239: 0
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: BT82313
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT82313%27 HTTP/1.1" 200 None
2026-03-28 12:05:18 [auto1.it] INFO: Scrape type for BT82313: 0
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: MN04958
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: LR68259
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: WB58416
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB58416%27 HTTP/1.1" 200 None
2026-03-28 12:05:18 [auto1.it] INFO: Scrape type for WB58416: 2
2026-03-28 12:05:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74914a42-d1b1-50af-9fad-344cece9172a with identifier: WB58416
2026-03-28 12:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74914a42-d1b1-50af-9fad-344cece9172a with scrape type 2
2026-03-28 12:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74914a42-d1b1-50af-9fad-344cece9172a with scrape type 2
2026-03-28 12:05:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 74914a42-d1b1-50af-9fad-344cece9172a, identifier: WB58416
2026-03-28 12:05:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 74914a42-d1b1-50af-9fad-344cece9172a with identifier: WB58416
2026-03-28 12:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 74914a42-d1b1-50af-9fad-344cece9172a with identifier: WB58416
2026-03-28 12:05:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 74914a42-d1b1-50af-9fad-344cece9172a with identifier: WB58416 to the API
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:26:14Z',
 'fuel_type': 'diesel',
 'id': '74914a42-d1b1-50af-9fad-344cece9172a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB58416',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 167570,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-29',
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
 'transmission': 'automatic',
 'trim': 'Limited FWD',
 'year': 2018}
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB58416%27 HTTP/1.1" 200 None
2026-03-28 12:05:18 [auto1.it] INFO: Saving data for WB58416: {'auction_closing_time': 1774884374.0, 'created_time': 1773129491.141896, 'last_price_update_time': 1774699518.534977}
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WB58416') HTTP/1.1" 204 0
2026-03-28 12:05:18 [auto1.it] INFO: Channel: 24h | Page: 1 | totalHits: 3673 | hits on page: 40
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: CS61296
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS61296%27 HTTP/1.1" 200 None
2026-03-28 12:05:18 [auto1.it] INFO: Scrape type for CS61296: 1
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: KS37590
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: SN56705
2026-03-28 12:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: HA26837
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: DE59865
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: JE63706
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: CN51839
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: JR85955
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: MC18601
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: JH97185
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: SY20877
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: KT14926
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT14926%27 HTTP/1.1" 200 None
2026-03-28 12:05:18 [auto1.it] INFO: Scrape type for KT14926: 1
2026-03-28 12:05:18 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/SN56705/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: RK00703
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: KM72059
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: NL56799
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: CZ11346
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ11346%27 HTTP/1.1" 200 None
2026-03-28 12:05:18 [auto1.it] INFO: Scrape type for CZ11346: 0
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: ZV36877
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: AW40388
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW40388%27 HTTP/1.1" 200 None
2026-03-28 12:05:18 [auto1.it] INFO: Scrape type for AW40388: 0
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: UR17084
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: DE71304
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE71304%27 HTTP/1.1" 200 None
2026-03-28 12:05:18 [auto1.it] INFO: Scrape type for DE71304: 0
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: LA00570
2026-03-28 12:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:18 [auto1.it] INFO: Found listing with ID: SD18580
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD18580%27 HTTP/1.1" 200 None
2026-03-28 12:05:18 [auto1.it] INFO: Scrape type for SD18580: 2
2026-03-28 12:05:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8e44a06-a18c-5859-9c07-3c21cfc20b5b with identifier: SD18580
2026-03-28 12:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8e44a06-a18c-5859-9c07-3c21cfc20b5b with scrape type 2
2026-03-28 12:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8e44a06-a18c-5859-9c07-3c21cfc20b5b with scrape type 2
2026-03-28 12:05:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d8e44a06-a18c-5859-9c07-3c21cfc20b5b, identifier: SD18580
2026-03-28 12:05:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d8e44a06-a18c-5859-9c07-3c21cfc20b5b with identifier: SD18580
2026-03-28 12:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d8e44a06-a18c-5859-9c07-3c21cfc20b5b with identifier: SD18580
2026-03-28 12:05:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d8e44a06-a18c-5859-9c07-3c21cfc20b5b with identifier: SD18580 to the API
2026-03-28 12:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:06:27Z',
 'fuel_type': 'diesel',
 'id': 'd8e44a06-a18c-5859-9c07-3c21cfc20b5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD18580',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 197004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-04',
 'seller_name': None,
 'title': 'Opel Mokka 1.7 CDTI Ego ecoFlex',
 'transmission': 'manual',
 'trim': 'Ego ecoFlex',
 'year': 2014}
2026-03-28 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD18580%27 HTTP/1.1" 200 None
2026-03-28 12:05:19 [auto1.it] INFO: Saving data for SD18580: {'auction_closing_time': 1774883187.0, 'created_time': 1773867971.232816, 'last_price_update_time': 1774699519.753131}
2026-03-28 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SD18580') HTTP/1.1" 204 0
2026-03-28 12:05:19 [auto1.it] INFO: Found listing with ID: ST97650
2026-03-28 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST97650%27 HTTP/1.1" 200 None
2026-03-28 12:05:19 [auto1.it] INFO: Scrape type for ST97650: 0
2026-03-28 12:05:19 [auto1.it] INFO: Found listing with ID: CD54959
2026-03-28 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD54959%27 HTTP/1.1" 200 None
2026-03-28 12:05:19 [auto1.it] INFO: Scrape type for CD54959: 0
2026-03-28 12:05:19 [auto1.it] INFO: Found listing with ID: ZH08694
2026-03-28 12:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:19 [auto1.it] INFO: Found listing with ID: TW38851
2026-03-28 12:05:19 [auto1.it] INFO: Found listing with ID: RM24928
2026-03-28 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM24928%27 HTTP/1.1" 200 None
2026-03-28 12:05:19 [auto1.it] INFO: Scrape type for RM24928: 1
2026-03-28 12:05:19 [auto1.it] INFO: Found listing with ID: WN91380
2026-03-28 12:05:19 [auto1.it] INFO: Found listing with ID: RT10721
2026-03-28 12:05:19 [auto1.it] INFO: Found listing with ID: DF57379
2026-03-28 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF57379%27 HTTP/1.1" 200 None
2026-03-28 12:05:20 [auto1.it] INFO: Scrape type for DF57379: 1
2026-03-28 12:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LA00570/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:20 [auto1.it] INFO: Found listing with ID: XL68174
2026-03-28 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL68174%27 HTTP/1.1" 200 None
2026-03-28 12:05:20 [auto1.it] INFO: Scrape type for XL68174: 0
2026-03-28 12:05:20 [auto1.it] INFO: Found listing with ID: NR40821
2026-03-28 12:05:20 [auto1.it] INFO: Found listing with ID: NR41367
2026-03-28 12:05:20 [auto1.it] INFO: Found listing with ID: DS09954
2026-03-28 12:05:20 [auto1.it] INFO: Found listing with ID: EF37813
2026-03-28 12:05:20 [auto1.it] INFO: Found listing with ID: CJ77239
2026-03-28 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CJ77239%27 HTTP/1.1" 200 None
2026-03-28 12:05:20 [auto1.it] INFO: Scrape type for CJ77239: 0
2026-03-28 12:05:20 [auto1.it] INFO: Found listing with ID: BT82313
2026-03-28 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT82313%27 HTTP/1.1" 200 None
2026-03-28 12:05:20 [auto1.it] INFO: Scrape type for BT82313: 0
2026-03-28 12:05:20 [auto1.it] INFO: Found listing with ID: MN04958
2026-03-28 12:05:20 [auto1.it] INFO: Found listing with ID: LR68259
2026-03-28 12:05:20 [auto1.it] INFO: Found listing with ID: WB58416
2026-03-28 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB58416%27 HTTP/1.1" 200 None
2026-03-28 12:05:20 [auto1.it] INFO: Scrape type for WB58416: 0
2026-03-28 12:05:20 [auto1.it] INFO: Found listing with ID: CS61296
2026-03-28 12:05:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:20 [auto1.it] INFO: Found listing with ID: HA26837
2026-03-28 12:05:20 [auto1.it] INFO: Found listing with ID: DE59865
2026-03-28 12:05:20 [auto1.it] INFO: Found listing with ID: JE63706
2026-03-28 12:05:20 [auto1.it] INFO: Found listing with ID: CN51839
2026-03-28 12:05:20 [auto1.it] INFO: Found listing with ID: JR85955
2026-03-28 12:05:20 [auto1.it] INFO: Found listing with ID: MC18601
2026-03-28 12:05:20 [auto1.it] INFO: Found listing with ID: JH97185
2026-03-28 12:05:20 [auto1.it] INFO: Found listing with ID: SY20877
2026-03-28 12:05:20 [auto1.it] INFO: Found listing with ID: KT14926
2026-03-28 12:05:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:20 [auto1.it] INFO: Found listing with ID: SD18580
2026-03-28 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD18580%27 HTTP/1.1" 200 None
2026-03-28 12:05:20 [auto1.it] INFO: Scrape type for SD18580: 0
2026-03-28 12:05:20 [auto1.it] INFO: Found listing with ID: TW38851
2026-03-28 12:05:20 [auto1.it] INFO: Found listing with ID: RM24928
2026-03-28 12:05:20 [auto1.it] INFO: Found listing with ID: DF57379
2026-03-28 12:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CS61296/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZH08694/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:20 [auto1.it] INFO: Channel: 24h | Page: 2 | totalHits: 3673 | hits on page: 40
2026-03-28 12:05:20 [auto1.it] INFO: Found listing with ID: VG07643
2026-03-28 12:05:20 [auto1.it] INFO: Found listing with ID: XB46951
2026-03-28 12:05:20 [auto1.it] INFO: Found listing with ID: UN20093
2026-03-28 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN20093%27 HTTP/1.1" 200 None
2026-03-28 12:05:20 [auto1.it] INFO: Scrape type for UN20093: 1
2026-03-28 12:05:20 [auto1.it] INFO: Found listing with ID: UT21803
2026-03-28 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT21803%27 HTTP/1.1" 200 None
2026-03-28 12:05:20 [auto1.it] INFO: Scrape type for UT21803: 2
2026-03-28 12:05:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f238ddb-4a51-5a42-b456-4fe42904a8e3 with identifier: UT21803
2026-03-28 12:05:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f238ddb-4a51-5a42-b456-4fe42904a8e3 with scrape type 2
2026-03-28 12:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f238ddb-4a51-5a42-b456-4fe42904a8e3 with scrape type 2
2026-03-28 12:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5f238ddb-4a51-5a42-b456-4fe42904a8e3, identifier: UT21803
2026-03-28 12:05:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5f238ddb-4a51-5a42-b456-4fe42904a8e3 with identifier: UT21803
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-28 12:05:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:05:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5f238ddb-4a51-5a42-b456-4fe42904a8e3 with identifier: UT21803
2026-03-28 12:05:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5f238ddb-4a51-5a42-b456-4fe42904a8e3 with identifier: UT21803 to the API
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:20:22Z',
 'fuel_type': 'diesel',
 'id': '5f238ddb-4a51-5a42-b456-4fe42904a8e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT21803',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 94776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-03',
 'seller_name': None,
 'title': 'Fiat Panda 1.3 JTD Cross 4x4',
 'transmission': 'manual',
 'trim': 'Cross 4x4',
 'year': 2011}
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT21803%27 HTTP/1.1" 200 None
2026-03-28 12:05:21 [auto1.it] INFO: Saving data for UT21803: {'auction_closing_time': 1774884022.0, 'created_time': 1773954561.034109, 'last_price_update_time': 1774699521.513677}
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UT21803') HTTP/1.1" 204 0
2026-03-28 12:05:21 [auto1.it] INFO: Found listing with ID: YJ81563
2026-03-28 12:05:21 [auto1.it] INFO: Found listing with ID: RC42052
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC42052%27 HTTP/1.1" 200 None
2026-03-28 12:05:21 [auto1.it] INFO: Scrape type for RC42052: 1
2026-03-28 12:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LA00570> (referer: https://www.auto1.com/v1/car-details-view/LA00570/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DF57379/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:21 [auto1.it] INFO: Found listing with ID: JF24469
2026-03-28 12:05:21 [auto1.it] INFO: Found listing with ID: VZ90962
2026-03-28 12:05:21 [auto1.it] INFO: Found listing with ID: FR55532
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR55532%27 HTTP/1.1" 200 None
2026-03-28 12:05:21 [auto1.it] INFO: Scrape type for FR55532: 1
2026-03-28 12:05:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RM24928/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KT14926/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:21 [auto1.it] INFO: Found listing with ID: BL56378
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL56378%27 HTTP/1.1" 200 None
2026-03-28 12:05:21 [auto1.it] INFO: Scrape type for BL56378: 1
2026-03-28 12:05:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:21 [auto1.it] INFO: Found listing with ID: HF54587
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF54587%27 HTTP/1.1" 200 None
2026-03-28 12:05:21 [auto1.it] INFO: Scrape type for HF54587: 2
2026-03-28 12:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49c7ed60-fa24-578f-8472-4fe6ee5fc6eb with identifier: HF54587
2026-03-28 12:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49c7ed60-fa24-578f-8472-4fe6ee5fc6eb with scrape type 2
2026-03-28 12:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49c7ed60-fa24-578f-8472-4fe6ee5fc6eb with scrape type 2
2026-03-28 12:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 49c7ed60-fa24-578f-8472-4fe6ee5fc6eb, identifier: HF54587
2026-03-28 12:05:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 49c7ed60-fa24-578f-8472-4fe6ee5fc6eb with identifier: HF54587
2026-03-28 12:05:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 49c7ed60-fa24-578f-8472-4fe6ee5fc6eb with identifier: HF54587
2026-03-28 12:05:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 49c7ed60-fa24-578f-8472-4fe6ee5fc6eb with identifier: HF54587 to the API
2026-03-28 12:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:56:48Z',
 'fuel_type': 'petrol',
 'id': '49c7ed60-fa24-578f-8472-4fe6ee5fc6eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF54587',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 172321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-31',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 150 Avantgarde',
 'transmission': 'manual',
 'trim': 'Avantgarde',
 'year': 2009}
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF54587%27 HTTP/1.1" 200 None
2026-03-28 12:05:22 [auto1.it] INFO: Saving data for HF54587: {'auction_closing_time': 1774886208.0, 'created_time': 1774343224.005639, 'last_price_update_time': 1774699522.149981}
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HF54587') HTTP/1.1" 204 0
2026-03-28 12:05:22 [auto1.it] INFO: Found listing with ID: AY76833
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY76833%27 HTTP/1.1" 200 None
2026-03-28 12:05:22 [auto1.it] INFO: Scrape type for AY76833: 1
2026-03-28 12:05:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b75f202e-9b63-5ec9-a643-e77ed3755145 with identifier: LA00570
2026-03-28 12:05:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b75f202e-9b63-5ec9-a643-e77ed3755145 with scrape type 1
2026-03-28 12:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b75f202e-9b63-5ec9-a643-e77ed3755145
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fbf%252F2ebf054001ba565f67c54db0c02d9dc7%252Fpa%252FLA00570_d4d2718c6eac298bb63d9831ce90a808.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/bf/2ebf054001ba565f67c54db0c02d9dc7/pa/LA00570_d4d2718c6eac298bb63d9831ce90a808.jpg already downloaded
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fbf%252F2ebf054001ba565f67c54db0c02d9dc7%252Fpa%252FLA00570_b895550498695d22a8c0a9e4fe2df4a8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/bf/2ebf054001ba565f67c54db0c02d9dc7/pa/LA00570_b895550498695d22a8c0a9e4fe2df4a8.jpg already downloaded
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fbf%252F2ebf054001ba565f67c54db0c02d9dc7%252Fpa%252FLA00570_9a2152f7157adf33cb784eac7659b04d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/bf/2ebf054001ba565f67c54db0c02d9dc7/pa/LA00570_9a2152f7157adf33cb784eac7659b04d.jpg already downloaded
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fbf%252F2ebf054001ba565f67c54db0c02d9dc7%252Fpa%252FLA00570_17ae7ba8162f223bbc9b115837f4c33d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/bf/2ebf054001ba565f67c54db0c02d9dc7/pa/LA00570_17ae7ba8162f223bbc9b115837f4c33d.jpg already downloaded
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fbf%252F2ebf054001ba565f67c54db0c02d9dc7%252Fpa%252FLA00570_d4c7253e44216dcc8cd9c38752035716.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/bf/2ebf054001ba565f67c54db0c02d9dc7/pa/LA00570_d4c7253e44216dcc8cd9c38752035716.jpg already downloaded
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fbf%252F2ebf054001ba565f67c54db0c02d9dc7%252Fpa%252FLA00570_611a7f55a6725cf175a97e08837c95b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/bf/2ebf054001ba565f67c54db0c02d9dc7/pa/LA00570_611a7f55a6725cf175a97e08837c95b0.jpg already downloaded
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fbf%252F2ebf054001ba565f67c54db0c02d9dc7%252Fpa%252FLA00570_653e38aca32ecf9cd1c20264344ae204.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/bf/2ebf054001ba565f67c54db0c02d9dc7/pa/LA00570_653e38aca32ecf9cd1c20264344ae204.jpg already downloaded
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fbf%252F2ebf054001ba565f67c54db0c02d9dc7%252Fpa%252FLA00570_c8d7f6474bacb0d2f7e35fbabe655f9f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/bf/2ebf054001ba565f67c54db0c02d9dc7/pa/LA00570_c8d7f6474bacb0d2f7e35fbabe655f9f.jpg already downloaded
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fbf%252F2ebf054001ba565f67c54db0c02d9dc7%252Fpa%252FLA00570_8fe2228043e0eaee44941e0ba9c43010.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/bf/2ebf054001ba565f67c54db0c02d9dc7/pa/LA00570_8fe2228043e0eaee44941e0ba9c43010.jpg already downloaded
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fbf%252F2ebf054001ba565f67c54db0c02d9dc7%252Fpa%252FLA00570_ad6e1544e219ad6b4a16326fa0738503.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/bf/2ebf054001ba565f67c54db0c02d9dc7/pa/LA00570_ad6e1544e219ad6b4a16326fa0738503.jpg already downloaded
2026-03-28 12:05:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b75f202e-9b63-5ec9-a643-e77ed3755145, identifier: LA00570
2026-03-28 12:05:22 [auto1.it] INFO: Found listing with ID: RJ05786
2026-03-28 12:05:22 [auto1.it] INFO: Found listing with ID: CV60870
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV60870%27 HTTP/1.1" 200 None
2026-03-28 12:05:22 [auto1.it] INFO: Scrape type for CV60870: 1
2026-03-28 12:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SN56705/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b75f202e-9b63-5ec9-a643-e77ed3755145 with identifier: LA00570
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 12:05:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b75f202e-9b63-5ec9-a643-e77ed3755145 with identifier: LA00570
2026-03-28 12:05:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b75f202e-9b63-5ec9-a643-e77ed3755145 with identifier: LA00570 to the API
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LA00570>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:12:39Z',
 'fuel_type': 'diesel',
 'id': 'b75f202e-9b63-5ec9-a643-e77ed3755145',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA00570',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Jeep',
 'model': 'Cherokee',
 'odometer': 277646,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photo_urls': ['https://img-pa.auto1.com/img2e/bf/2ebf054001ba565f67c54db0c02d9dc7/pa/LA00570_d4d2718c6eac298bb63d9831ce90a808.jpg',
                'https://img-pa.auto1.com/img2e/bf/2ebf054001ba565f67c54db0c02d9dc7/pa/LA00570_b895550498695d22a8c0a9e4fe2df4a8.jpg',
                'https://img-pa.auto1.com/img2e/bf/2ebf054001ba565f67c54db0c02d9dc7/pa/LA00570_9a2152f7157adf33cb784eac7659b04d.jpg',
                'https://img-pa.auto1.com/img2e/bf/2ebf054001ba565f67c54db0c02d9dc7/pa/LA00570_17ae7ba8162f223bbc9b115837f4c33d.jpg',
                'https://img-pa.auto1.com/img2e/bf/2ebf054001ba565f67c54db0c02d9dc7/pa/LA00570_d4c7253e44216dcc8cd9c38752035716.jpg',
                'https://img-pa.auto1.com/img2e/bf/2ebf054001ba565f67c54db0c02d9dc7/pa/LA00570_611a7f55a6725cf175a97e08837c95b0.jpg',
                'https://img-pa.auto1.com/img2e/bf/2ebf054001ba565f67c54db0c02d9dc7/pa/LA00570_653e38aca32ecf9cd1c20264344ae204.jpg',
                'https://img-pa.auto1.com/img2e/bf/2ebf054001ba565f67c54db0c02d9dc7/pa/LA00570_c8d7f6474bacb0d2f7e35fbabe655f9f.jpg',
                'https://img-pa.auto1.com/img2e/bf/2ebf054001ba565f67c54db0c02d9dc7/pa/LA00570_8fe2228043e0eaee44941e0ba9c43010.jpg',
                'https://img-pa.auto1.com/img2e/bf/2ebf054001ba565f67c54db0c02d9dc7/pa/LA00570_ad6e1544e219ad6b4a16326fa0738503.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75f202e-9b63-5ec9-a643-e77ed3755145/b75f202e-9b63-5ec9-a643-e77ed3755145_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 130339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/bf/2ebf054001ba565f67c54db0c02d9dc7/pa/LA00570_d4d2718c6eac298bb63d9831ce90a808.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75f202e-9b63-5ec9-a643-e77ed3755145/b75f202e-9b63-5ec9-a643-e77ed3755145_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 130339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/bf/2ebf054001ba565f67c54db0c02d9dc7/pa/LA00570_b895550498695d22a8c0a9e4fe2df4a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75f202e-9b63-5ec9-a643-e77ed3755145/b75f202e-9b63-5ec9-a643-e77ed3755145_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/bf/2ebf054001ba565f67c54db0c02d9dc7/pa/LA00570_9a2152f7157adf33cb784eac7659b04d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75f202e-9b63-5ec9-a643-e77ed3755145/b75f202e-9b63-5ec9-a643-e77ed3755145_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/bf/2ebf054001ba565f67c54db0c02d9dc7/pa/LA00570_17ae7ba8162f223bbc9b115837f4c33d.jpg',
             'Width': 737},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75f202e-9b63-5ec9-a643-e77ed3755145/b75f202e-9b63-5ec9-a643-e77ed3755145_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106897,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/bf/2ebf054001ba565f67c54db0c02d9dc7/pa/LA00570_d4c7253e44216dcc8cd9c38752035716.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75f202e-9b63-5ec9-a643-e77ed3755145/b75f202e-9b63-5ec9-a643-e77ed3755145_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/bf/2ebf054001ba565f67c54db0c02d9dc7/pa/LA00570_611a7f55a6725cf175a97e08837c95b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75f202e-9b63-5ec9-a643-e77ed3755145/b75f202e-9b63-5ec9-a643-e77ed3755145_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/bf/2ebf054001ba565f67c54db0c02d9dc7/pa/LA00570_653e38aca32ecf9cd1c20264344ae204.jpg',
             'Width': 729},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75f202e-9b63-5ec9-a643-e77ed3755145/b75f202e-9b63-5ec9-a643-e77ed3755145_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/bf/2ebf054001ba565f67c54db0c02d9dc7/pa/LA00570_c8d7f6474bacb0d2f7e35fbabe655f9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75f202e-9b63-5ec9-a643-e77ed3755145/b75f202e-9b63-5ec9-a643-e77ed3755145_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/bf/2ebf054001ba565f67c54db0c02d9dc7/pa/LA00570_8fe2228043e0eaee44941e0ba9c43010.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75f202e-9b63-5ec9-a643-e77ed3755145/b75f202e-9b63-5ec9-a643-e77ed3755145_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/bf/2ebf054001ba565f67c54db0c02d9dc7/pa/LA00570_ad6e1544e219ad6b4a16326fa0738503.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-07-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Cherokee 2.0 M-Jet Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2014}
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA00570%27 HTTP/1.1" 200 None
2026-03-28 12:05:22 [auto1.it] INFO: Saving data for LA00570: {'created_time': 1774699522.986735, 'last_price_update_time': 1774699522.986783, 'auction_closing_time': 1774883559.0}
2026-03-28 12:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LA00570') HTTP/1.1" 204 0
2026-03-28 12:05:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:23 [auto1.it] INFO: Found listing with ID: PM98470
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM98470%27 HTTP/1.1" 200 None
2026-03-28 12:05:23 [auto1.it] INFO: Scrape type for PM98470: 2
2026-03-28 12:05:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42697d75-a4de-5898-8892-32911d555c6f with identifier: PM98470
2026-03-28 12:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42697d75-a4de-5898-8892-32911d555c6f with scrape type 2
2026-03-28 12:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42697d75-a4de-5898-8892-32911d555c6f with scrape type 2
2026-03-28 12:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 42697d75-a4de-5898-8892-32911d555c6f, identifier: PM98470
2026-03-28 12:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 42697d75-a4de-5898-8892-32911d555c6f with identifier: PM98470
2026-03-28 12:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 42697d75-a4de-5898-8892-32911d555c6f with identifier: PM98470
2026-03-28 12:05:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 42697d75-a4de-5898-8892-32911d555c6f with identifier: PM98470 to the API
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:08:31Z',
 'fuel_type': 'diesel',
 'id': '42697d75-a4de-5898-8892-32911d555c6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM98470',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 191601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-25',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Sport Edition BlueMotion Tech.',
 'transmission': 'automatic',
 'trim': 'Sport Edition BlueMotion Tech.',
 'year': 2016}
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM98470%27 HTTP/1.1" 200 None
2026-03-28 12:05:23 [auto1.it] INFO: Saving data for PM98470: {'auction_closing_time': 1774883311.0, 'created_time': 1773911212.078176, 'last_price_update_time': 1774699523.487454}
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PM98470') HTTP/1.1" 204 0
2026-03-28 12:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZH08694> (referer: https://www.auto1.com/v1/car-details-view/ZH08694/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CS61296> (referer: https://www.auto1.com/v1/car-details-view/CS61296/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:23 [auto1.it] INFO: Found listing with ID: XT30792
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT30792%27 HTTP/1.1" 200 None
2026-03-28 12:05:23 [auto1.it] INFO: Scrape type for XT30792: 2
2026-03-28 12:05:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3b05b74-84a5-55fa-b47e-212e0392da9e with identifier: XT30792
2026-03-28 12:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3b05b74-84a5-55fa-b47e-212e0392da9e with scrape type 2
2026-03-28 12:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3b05b74-84a5-55fa-b47e-212e0392da9e with scrape type 2
2026-03-28 12:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c3b05b74-84a5-55fa-b47e-212e0392da9e, identifier: XT30792
2026-03-28 12:05:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c3b05b74-84a5-55fa-b47e-212e0392da9e with identifier: XT30792
2026-03-28 12:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c3b05b74-84a5-55fa-b47e-212e0392da9e with identifier: XT30792
2026-03-28 12:05:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c3b05b74-84a5-55fa-b47e-212e0392da9e with identifier: XT30792 to the API
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:52:32Z',
 'fuel_type': 'petrol',
 'id': 'c3b05b74-84a5-55fa-b47e-212e0392da9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT30792',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 155548,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-29',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Turbo Elective',
 'transmission': 'manual',
 'trim': 'Elective',
 'year': 2014}
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT30792%27 HTTP/1.1" 200 None
2026-03-28 12:05:24 [auto1.it] INFO: Saving data for XT30792: {'auction_closing_time': 1774885952.0, 'created_time': 1773934897.903183, 'last_price_update_time': 1774699524.079183}
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XT30792') HTTP/1.1" 204 0
2026-03-28 12:05:24 [auto1.it] INFO: Found listing with ID: HD11089
2026-03-28 12:05:24 [auto1.it] INFO: Found listing with ID: WM47642
2026-03-28 12:05:24 [auto1.it] INFO: Found listing with ID: KH13960
2026-03-28 12:05:24 [auto1.it] INFO: Found listing with ID: JU86722
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU86722%27 HTTP/1.1" 200 None
2026-03-28 12:05:24 [auto1.it] INFO: Scrape type for JU86722: 1
2026-03-28 12:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:24 [auto1.it] INFO: Found listing with ID: WS77593
2026-03-28 12:05:24 [auto1.it] INFO: Found listing with ID: KM48378
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM48378%27 HTTP/1.1" 200 None
2026-03-28 12:05:24 [auto1.it] INFO: Scrape type for KM48378: 1
2026-03-28 12:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FR55532/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RC42052/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UN20093/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 162bacd6-cf45-5c7b-b8fb-2349c890dad3 with identifier: ZH08694
2026-03-28 12:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 162bacd6-cf45-5c7b-b8fb-2349c890dad3 with scrape type 1
2026-03-28 12:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 162bacd6-cf45-5c7b-b8fb-2349c890dad3
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Ff4%252F69f426301771797af1096b611f3f27b5%252Fpa%252FZH08694_af43cfb4f093b920c90ec6e3a3dc94a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_af43cfb4f093b920c90ec6e3a3dc94a6.jpg not downloaded yet
2026-03-28 12:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 515399f1-c951-5577-88f0-8b40f453c68e with identifier: CS61296
2026-03-28 12:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 515399f1-c951-5577-88f0-8b40f453c68e with scrape type 1
2026-03-28 12:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 515399f1-c951-5577-88f0-8b40f453c68e
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd8%252Faed8d8d55f35b476d34c76ba49929d73%252Fpa%252FCS61296_7aa443351fec4078250ec1ae89abdad8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_7aa443351fec4078250ec1ae89abdad8.jpg not downloaded yet
2026-03-28 12:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:24 [auto1.it] INFO: Found listing with ID: ET22397
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET22397%27 HTTP/1.1" 200 None
2026-03-28 12:05:24 [auto1.it] INFO: Scrape type for ET22397: 1
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Ff4%252F69f426301771797af1096b611f3f27b5%252Fpa%252FZH08694_00a5d09bb5aa00473e91feaeed2bf604.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_00a5d09bb5aa00473e91feaeed2bf604.jpg not downloaded yet
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd8%252Faed8d8d55f35b476d34c76ba49929d73%252Fpa%252FCS61296_35de2206471dae647c49544216e2a0f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_35de2206471dae647c49544216e2a0f6.jpg not downloaded yet
2026-03-28 12:05:24 [auto1.it] INFO: Found listing with ID: ML76939
2026-03-28 12:05:24 [auto1.it] INFO: Found listing with ID: TB64568
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB64568%27 HTTP/1.1" 200 None
2026-03-28 12:05:24 [auto1.it] INFO: Scrape type for TB64568: 2
2026-03-28 12:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fb0b2b2-e0a1-5993-bce2-6dd892729c7c with identifier: TB64568
2026-03-28 12:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fb0b2b2-e0a1-5993-bce2-6dd892729c7c with scrape type 2
2026-03-28 12:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2fb0b2b2-e0a1-5993-bce2-6dd892729c7c with scrape type 2
2026-03-28 12:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2fb0b2b2-e0a1-5993-bce2-6dd892729c7c, identifier: TB64568
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Ff4%252F69f426301771797af1096b611f3f27b5%252Fpa%252FZH08694_b9ab3771da12e8806050cdb07328a2a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_b9ab3771da12e8806050cdb07328a2a1.jpg not downloaded yet
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd8%252Faed8d8d55f35b476d34c76ba49929d73%252Fpa%252FCS61296_eb7d90a6d8b77361341be1dca9be0fa5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_eb7d90a6d8b77361341be1dca9be0fa5.jpg not downloaded yet
2026-03-28 12:05:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2fb0b2b2-e0a1-5993-bce2-6dd892729c7c with identifier: TB64568
2026-03-28 12:05:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2fb0b2b2-e0a1-5993-bce2-6dd892729c7c with identifier: TB64568
2026-03-28 12:05:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2fb0b2b2-e0a1-5993-bce2-6dd892729c7c with identifier: TB64568 to the API
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:48:07Z',
 'fuel_type': 'diesel',
 'id': '2fb0b2b2-e0a1-5993-bce2-6dd892729c7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB64568',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 224642,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-09',
 'seller_name': None,
 'title': 'Hyundai ix35 1.7 CRDi Comfort 2WD',
 'transmission': 'manual',
 'trim': 'Comfort 2WD',
 'year': 2011}
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB64568%27 HTTP/1.1" 200 None
2026-03-28 12:05:24 [auto1.it] INFO: Saving data for TB64568: {'auction_closing_time': 1774885687.0, 'created_time': 1773136662.671549, 'last_price_update_time': 1774699524.811137}
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TB64568') HTTP/1.1" 204 0
2026-03-28 12:05:24 [auto1.it] INFO: Channel: 24h | Page: 3 | totalHits: 3673 | hits on page: 40
2026-03-28 12:05:24 [auto1.it] INFO: Found listing with ID: ZU99068
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU99068%27 HTTP/1.1" 200 None
2026-03-28 12:05:24 [auto1.it] INFO: Scrape type for ZU99068: 1
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Ff4%252F69f426301771797af1096b611f3f27b5%252Fpa%252FZH08694_463922be767041f935601ec2432d9600.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_463922be767041f935601ec2432d9600.jpg not downloaded yet
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd8%252Faed8d8d55f35b476d34c76ba49929d73%252Fpa%252FCS61296_2f2c7d584cf17605bb91ed77812908b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_2f2c7d584cf17605bb91ed77812908b7.jpg not downloaded yet
2026-03-28 12:05:24 [auto1.it] INFO: Found listing with ID: BU30300
2026-03-28 12:05:24 [auto1.it] INFO: Found listing with ID: WE07120
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WE07120%27 HTTP/1.1" 200 None
2026-03-28 12:05:24 [auto1.it] INFO: Scrape type for WE07120: 1
2026-03-28 12:05:24 [auto1.it] INFO: Found listing with ID: VL91397
2026-03-28 12:05:24 [auto1.it] INFO: Found listing with ID: WG77442
2026-03-28 12:05:24 [auto1.it] INFO: Found listing with ID: LE72169
2026-03-28 12:05:24 [auto1.it] INFO: Found listing with ID: UR17462
2026-03-28 12:05:24 [auto1.it] INFO: Found listing with ID: DU34377
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU34377%27 HTTP/1.1" 200 None
2026-03-28 12:05:24 [auto1.it] INFO: Scrape type for DU34377: 1
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Ff4%252F69f426301771797af1096b611f3f27b5%252Fpa%252FZH08694_2430d9ed86818c72fa9251bc336f9838.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_2430d9ed86818c72fa9251bc336f9838.jpg not downloaded yet
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd8%252Faed8d8d55f35b476d34c76ba49929d73%252Fpa%252FCS61296_6422c60a83d229c9b64bebe653687334.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_6422c60a83d229c9b64bebe653687334.jpg not downloaded yet
2026-03-28 12:05:24 [auto1.it] INFO: Found listing with ID: NF75023
2026-03-28 12:05:24 [auto1.it] INFO: Found listing with ID: VZ92626
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VZ92626%27 HTTP/1.1" 200 None
2026-03-28 12:05:24 [auto1.it] INFO: Scrape type for VZ92626: 1
2026-03-28 12:05:24 [auto1.it] INFO: Found listing with ID: EV59116
2026-03-28 12:05:24 [auto1.it] INFO: Found listing with ID: UY41081
2026-03-28 12:05:24 [auto1.it] INFO: Found listing with ID: VK68045
2026-03-28 12:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK68045%27 HTTP/1.1" 200 None
2026-03-28 12:05:25 [auto1.it] INFO: Scrape type for VK68045: 1
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Ff4%252F69f426301771797af1096b611f3f27b5%252Fpa%252FZH08694_ab49e9ecfd1762f502fbf4863cce5f61.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_ab49e9ecfd1762f502fbf4863cce5f61.jpg not downloaded yet
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd8%252Faed8d8d55f35b476d34c76ba49929d73%252Fpa%252FCS61296_2a7d55d1a1819f43bcb189cba23cc008.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_2a7d55d1a1819f43bcb189cba23cc008.jpg not downloaded yet
2026-03-28 12:05:25 [auto1.it] INFO: Found listing with ID: TF83722
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF83722%27 HTTP/1.1" 200 None
2026-03-28 12:05:25 [auto1.it] INFO: Scrape type for TF83722: 1
2026-03-28 12:05:25 [auto1.it] INFO: Found listing with ID: YN18335
2026-03-28 12:05:25 [auto1.it] INFO: Found listing with ID: NA95464
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA95464%27 HTTP/1.1" 200 None
2026-03-28 12:05:25 [auto1.it] INFO: Scrape type for NA95464: 2
2026-03-28 12:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91878baa-e7fb-545e-8514-a7e76e620491 with identifier: NA95464
2026-03-28 12:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91878baa-e7fb-545e-8514-a7e76e620491 with scrape type 2
2026-03-28 12:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91878baa-e7fb-545e-8514-a7e76e620491 with scrape type 2
2026-03-28 12:05:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 91878baa-e7fb-545e-8514-a7e76e620491, identifier: NA95464
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Ff4%252F69f426301771797af1096b611f3f27b5%252Fpa%252FZH08694_bec26742175c8efa21b32ea532de3e6f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_bec26742175c8efa21b32ea532de3e6f.jpg not downloaded yet
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd8%252Faed8d8d55f35b476d34c76ba49929d73%252Fpa%252FCS61296_b03c3018e8321e40568d2e673d39d072.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_b03c3018e8321e40568d2e673d39d072.jpg not downloaded yet
2026-03-28 12:05:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 91878baa-e7fb-545e-8514-a7e76e620491 with identifier: NA95464
2026-03-28 12:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 91878baa-e7fb-545e-8514-a7e76e620491 with identifier: NA95464
2026-03-28 12:05:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 91878baa-e7fb-545e-8514-a7e76e620491 with identifier: NA95464 to the API
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:20:09Z',
 'fuel_type': 'diesel',
 'id': '91878baa-e7fb-545e-8514-a7e76e620491',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA95464',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 163512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-21',
 'seller_name': None,
 'title': 'Audi Q5 40 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA95464%27 HTTP/1.1" 200 None
2026-03-28 12:05:25 [auto1.it] INFO: Saving data for NA95464: {'auction_closing_time': 1774884009.0, 'created_time': 1774343254.893295, 'last_price_update_time': 1774699525.568931}
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NA95464') HTTP/1.1" 204 0
2026-03-28 12:05:25 [auto1.it] INFO: Found listing with ID: BA01278
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA01278%27 HTTP/1.1" 200 None
2026-03-28 12:05:25 [auto1.it] INFO: Scrape type for BA01278: 1
2026-03-28 12:05:25 [auto1.it] INFO: Found listing with ID: WA05506
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA05506%27 HTTP/1.1" 200 None
2026-03-28 12:05:25 [auto1.it] INFO: Scrape type for WA05506: 1
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Ff4%252F69f426301771797af1096b611f3f27b5%252Fpa%252FZH08694_e6d70a682a47f14d067417ebde06dfbb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_e6d70a682a47f14d067417ebde06dfbb.jpg not downloaded yet
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd8%252Faed8d8d55f35b476d34c76ba49929d73%252Fpa%252FCS61296_68ea54a5d65790be5b52083fb59d0253.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_68ea54a5d65790be5b52083fb59d0253.jpg not downloaded yet
2026-03-28 12:05:25 [auto1.it] INFO: Found listing with ID: PW47751
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW47751%27 HTTP/1.1" 200 None
2026-03-28 12:05:25 [auto1.it] INFO: Scrape type for PW47751: 1
2026-03-28 12:05:25 [auto1.it] INFO: Found listing with ID: PW96424
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW96424%27 HTTP/1.1" 200 None
2026-03-28 12:05:25 [auto1.it] INFO: Scrape type for PW96424: 1
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Ff4%252F69f426301771797af1096b611f3f27b5%252Fpa%252FZH08694_e8bd537a10ed01b255b9f4f42f64b6b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_e8bd537a10ed01b255b9f4f42f64b6b9.jpg not downloaded yet
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd8%252Faed8d8d55f35b476d34c76ba49929d73%252Fpa%252FCS61296_e7f8ac0c220c6ca4abe2b61bdf21a39d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_e7f8ac0c220c6ca4abe2b61bdf21a39d.jpg not downloaded yet
2026-03-28 12:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BL56378/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:25 [auto1.it] INFO: Found listing with ID: CU74500
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU74500%27 HTTP/1.1" 200 None
2026-03-28 12:05:25 [auto1.it] INFO: Scrape type for CU74500: 1
2026-03-28 12:05:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KT14926> (referer: https://www.auto1.com/v1/car-details-view/KT14926/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:25 [auto1.it] INFO: Found listing with ID: CZ80815
2026-03-28 12:05:25 [auto1.it] INFO: Found listing with ID: YT14499
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Ff4%252F69f426301771797af1096b611f3f27b5%252Fpa%252FZH08694_08ad9f0fe4962df8e068c27cb8f3248c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_08ad9f0fe4962df8e068c27cb8f3248c.jpg not downloaded yet
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd8%252Faed8d8d55f35b476d34c76ba49929d73%252Fpa%252FCS61296_9e768f09ea978b8d8dda12fa3a100742.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_9e768f09ea978b8d8dda12fa3a100742.jpg not downloaded yet
2026-03-28 12:05:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_af43cfb4f093b920c90ec6e3a3dc94a6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:25 [auto1.it] INFO: Found listing with ID: SB06120
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB06120%27 HTTP/1.1" 200 None
2026-03-28 12:05:25 [auto1.it] INFO: Scrape type for SB06120: 1
2026-03-28 12:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RM24928> (referer: https://www.auto1.com/v1/car-details-view/RM24928/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:25 [auto1.it] INFO: Found listing with ID: VC50043
2026-03-28 12:05:25 [auto1.it] INFO: Found listing with ID: ZK25339
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK25339%27 HTTP/1.1" 200 None
2026-03-28 12:05:25 [auto1.it] INFO: Scrape type for ZK25339: 1
2026-03-28 12:05:25 [auto1.it] INFO: Found listing with ID: ZX07478
2026-03-28 12:05:25 [auto1.it] INFO: Found listing with ID: VY27693
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY27693%27 HTTP/1.1" 200 None
2026-03-28 12:05:25 [auto1.it] INFO: Scrape type for VY27693: 1
2026-03-28 12:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_35de2206471dae647c49544216e2a0f6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:25 [auto1.it] INFO: Found listing with ID: JZ77925
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ77925%27 HTTP/1.1" 200 None
2026-03-28 12:05:25 [auto1.it] INFO: Scrape type for JZ77925: 1
2026-03-28 12:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RT10721/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:25 [auto1.it] INFO: Found listing with ID: YY84618
2026-03-28 12:05:25 [auto1.it] INFO: Found listing with ID: LN66513
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN66513%27 HTTP/1.1" 200 None
2026-03-28 12:05:26 [auto1.it] INFO: Scrape type for LN66513: 1
2026-03-28 12:05:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b51a8a2c-1974-5620-a637-684ee20c2e01 with identifier: KT14926
2026-03-28 12:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b51a8a2c-1974-5620-a637-684ee20c2e01 with scrape type 1
2026-03-28 12:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item b51a8a2c-1974-5620-a637-684ee20c2e01
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F5b%252F235b7e2f4b8e4e0d718047316a1b4faf%252Fpa%252FKT14926_6b73083fb533e032e877b78e3668c317.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/5b/235b7e2f4b8e4e0d718047316a1b4faf/pa/KT14926_6b73083fb533e032e877b78e3668c317.jpg not downloaded yet
2026-03-28 12:05:26 [auto1.it] INFO: Found listing with ID: CE47539
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE47539%27 HTTP/1.1" 200 None
2026-03-28 12:05:26 [auto1.it] INFO: Scrape type for CE47539: 1
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F5b%252F235b7e2f4b8e4e0d718047316a1b4faf%252Fpa%252FKT14926_25db6fa1a5624d9446c782041b730578.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/5b/235b7e2f4b8e4e0d718047316a1b4faf/pa/KT14926_25db6fa1a5624d9446c782041b730578.jpg not downloaded yet
2026-03-28 12:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-28 12:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-28 12:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bf1d12d0>
2026-03-28 12:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_162bacd6-cf45-5c7b-b8fb-2349c890dad3/162bacd6-cf45-5c7b-b8fb-2349c890dad3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Ff4%252F69f426301771797af1096b611f3f27b5%252Fpa%252FZH08694_af43cfb4f093b920c90ec6e3a3dc94a6.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_af43cfb4f093b920c90ec6e3a3dc94a6.jpg saved to cache
2026-03-28 12:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 162bacd6-cf45-5c7b-b8fb-2349c890dad3
2026-03-28 12:05:26 [auto1.it] INFO: Found listing with ID: ET05908
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET05908%27 HTTP/1.1" 200 None
2026-03-28 12:05:26 [auto1.it] INFO: Scrape type for ET05908: 1
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F5b%252F235b7e2f4b8e4e0d718047316a1b4faf%252Fpa%252FKT14926_41d913f98c56c73276fd9e72e8135410.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/5b/235b7e2f4b8e4e0d718047316a1b4faf/pa/KT14926_41d913f98c56c73276fd9e72e8135410.jpg not downloaded yet
2026-03-28 12:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_00a5d09bb5aa00473e91feaeed2bf604.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:26 [auto1.it] INFO: Found listing with ID: YH77376
2026-03-28 12:05:26 [auto1.it] INFO: Found listing with ID: YF75384
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YF75384%27 HTTP/1.1" 200 None
2026-03-28 12:05:26 [auto1.it] INFO: Scrape type for YF75384: 2
2026-03-28 12:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a01347a-afaf-5d36-9027-acdc73c66feb with identifier: YF75384
2026-03-28 12:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a01347a-afaf-5d36-9027-acdc73c66feb with scrape type 2
2026-03-28 12:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a01347a-afaf-5d36-9027-acdc73c66feb with scrape type 2
2026-03-28 12:05:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7a01347a-afaf-5d36-9027-acdc73c66feb, identifier: YF75384
2026-03-28 12:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AY76833/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CV60870/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6 with identifier: RM24928
2026-03-28 12:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6 with scrape type 1
2026-03-28 12:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F6e%252F2e6e931ea4c84af014ee30f54ba5f884%252Fpa%252FRM24928_f31c0961ff6ab1b762bb8b99581f3820.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/6e/2e6e931ea4c84af014ee30f54ba5f884/pa/RM24928_f31c0961ff6ab1b762bb8b99581f3820.jpg already downloaded
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F6e%252F2e6e931ea4c84af014ee30f54ba5f884%252Fpa%252FRM24928_065d91762dfe52a1444882f60787445d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/6e/2e6e931ea4c84af014ee30f54ba5f884/pa/RM24928_065d91762dfe52a1444882f60787445d.jpg already downloaded
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F6e%252F2e6e931ea4c84af014ee30f54ba5f884%252Fpa%252FRM24928_10addc13d0cc46d326890a7ff2681757.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/6e/2e6e931ea4c84af014ee30f54ba5f884/pa/RM24928_10addc13d0cc46d326890a7ff2681757.jpg already downloaded
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F6e%252F2e6e931ea4c84af014ee30f54ba5f884%252Fpa%252FRM24928_5e1c8047b946301ac7d5e3671563034d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/6e/2e6e931ea4c84af014ee30f54ba5f884/pa/RM24928_5e1c8047b946301ac7d5e3671563034d.jpg already downloaded
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F6e%252F2e6e931ea4c84af014ee30f54ba5f884%252Fpa%252FRM24928_e9bae2abefcb11fb45c62509b8ac03ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/6e/2e6e931ea4c84af014ee30f54ba5f884/pa/RM24928_e9bae2abefcb11fb45c62509b8ac03ae.jpg already downloaded
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F6e%252F2e6e931ea4c84af014ee30f54ba5f884%252Fpa%252FRM24928_3b4b30c39e9ffdce5e01067963c0fea5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/6e/2e6e931ea4c84af014ee30f54ba5f884/pa/RM24928_3b4b30c39e9ffdce5e01067963c0fea5.jpg already downloaded
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F6e%252F2e6e931ea4c84af014ee30f54ba5f884%252Fpa%252FRM24928_578f7eab6270ca79e999740a58b7a7db.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/6e/2e6e931ea4c84af014ee30f54ba5f884/pa/RM24928_578f7eab6270ca79e999740a58b7a7db.jpg already downloaded
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F6e%252F2e6e931ea4c84af014ee30f54ba5f884%252Fpa%252FRM24928_21ca86df9c2b2c42a26cbe70fd4cb02e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/6e/2e6e931ea4c84af014ee30f54ba5f884/pa/RM24928_21ca86df9c2b2c42a26cbe70fd4cb02e.jpg already downloaded
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F6e%252F2e6e931ea4c84af014ee30f54ba5f884%252Fpa%252FRM24928_f9fa4ef42f7a660b83fa921f4a01b0b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/6e/2e6e931ea4c84af014ee30f54ba5f884/pa/RM24928_f9fa4ef42f7a660b83fa921f4a01b0b5.jpg already downloaded
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F6e%252F2e6e931ea4c84af014ee30f54ba5f884%252Fpa%252FRM24928_145843bca57d6d441a009bc3d824f3b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/6e/2e6e931ea4c84af014ee30f54ba5f884/pa/RM24928_145843bca57d6d441a009bc3d824f3b4.jpg already downloaded
2026-03-28 12:05:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6, identifier: RM24928
2026-03-28 12:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd0f2a50>
2026-03-28 12:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_515399f1-c951-5577-88f0-8b40f453c68e/515399f1-c951-5577-88f0-8b40f453c68e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd8%252Faed8d8d55f35b476d34c76ba49929d73%252Fpa%252FCS61296_35de2206471dae647c49544216e2a0f6.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_35de2206471dae647c49544216e2a0f6.jpg saved to cache
2026-03-28 12:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 515399f1-c951-5577-88f0-8b40f453c68e
2026-03-28 12:05:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7a01347a-afaf-5d36-9027-acdc73c66feb with identifier: YF75384
2026-03-28 12:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7a01347a-afaf-5d36-9027-acdc73c66feb with identifier: YF75384
2026-03-28 12:05:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7a01347a-afaf-5d36-9027-acdc73c66feb with identifier: YF75384 to the API
2026-03-28 12:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:28:14Z',
 'fuel_type': 'diesel',
 'id': '7a01347a-afaf-5d36-9027-acdc73c66feb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF75384',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 195074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-27',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d Mild-Hybrid xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2020}
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YF75384%27 HTTP/1.1" 200 None
2026-03-28 12:05:27 [auto1.it] INFO: Saving data for YF75384: {'auction_closing_time': 1774884494.0, 'created_time': 1773868360.122214, 'last_price_update_time': 1774699527.151363}
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YF75384') HTTP/1.1" 204 0
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F5b%252F235b7e2f4b8e4e0d718047316a1b4faf%252Fpa%252FKT14926_ac9b09844c5b0beb3559e7b0124820ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/5b/235b7e2f4b8e4e0d718047316a1b4faf/pa/KT14926_ac9b09844c5b0beb3559e7b0124820ae.jpg not downloaded yet
2026-03-28 12:05:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6 with identifier: RM24928
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-28 12:05:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:05:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6 with identifier: RM24928
2026-03-28 12:05:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6 with identifier: RM24928 to the API
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RM24928>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 147,
 'expiration_date': '2026-03-30T15:42:56Z',
 'fuel_type': 'gas',
 'id': '38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM24928',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Ssangyong',
 'model': 'Korando',
 'odometer': 173620,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img2e/6e/2e6e931ea4c84af014ee30f54ba5f884/pa/RM24928_f31c0961ff6ab1b762bb8b99581f3820.jpg',
                'https://img-pa.auto1.com/img2e/6e/2e6e931ea4c84af014ee30f54ba5f884/pa/RM24928_065d91762dfe52a1444882f60787445d.jpg',
                'https://img-pa.auto1.com/img2e/6e/2e6e931ea4c84af014ee30f54ba5f884/pa/RM24928_10addc13d0cc46d326890a7ff2681757.jpg',
                'https://img-pa.auto1.com/img2e/6e/2e6e931ea4c84af014ee30f54ba5f884/pa/RM24928_5e1c8047b946301ac7d5e3671563034d.jpg',
                'https://img-pa.auto1.com/img2e/6e/2e6e931ea4c84af014ee30f54ba5f884/pa/RM24928_e9bae2abefcb11fb45c62509b8ac03ae.jpg',
                'https://img-pa.auto1.com/img2e/6e/2e6e931ea4c84af014ee30f54ba5f884/pa/RM24928_3b4b30c39e9ffdce5e01067963c0fea5.jpg',
                'https://img-pa.auto1.com/img2e/6e/2e6e931ea4c84af014ee30f54ba5f884/pa/RM24928_578f7eab6270ca79e999740a58b7a7db.jpg',
                'https://img-pa.auto1.com/img2e/6e/2e6e931ea4c84af014ee30f54ba5f884/pa/RM24928_21ca86df9c2b2c42a26cbe70fd4cb02e.jpg',
                'https://img-pa.auto1.com/img2e/6e/2e6e931ea4c84af014ee30f54ba5f884/pa/RM24928_f9fa4ef42f7a660b83fa921f4a01b0b5.jpg',
                'https://img-pa.auto1.com/img2e/6e/2e6e931ea4c84af014ee30f54ba5f884/pa/RM24928_145843bca57d6d441a009bc3d824f3b4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6/38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/6e/2e6e931ea4c84af014ee30f54ba5f884/pa/RM24928_f31c0961ff6ab1b762bb8b99581f3820.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6/38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/6e/2e6e931ea4c84af014ee30f54ba5f884/pa/RM24928_065d91762dfe52a1444882f60787445d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6/38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/6e/2e6e931ea4c84af014ee30f54ba5f884/pa/RM24928_10addc13d0cc46d326890a7ff2681757.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6/38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2477041,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/6e/2e6e931ea4c84af014ee30f54ba5f884/pa/RM24928_5e1c8047b946301ac7d5e3671563034d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6/38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/6e/2e6e931ea4c84af014ee30f54ba5f884/pa/RM24928_e9bae2abefcb11fb45c62509b8ac03ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6/38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2629490,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/6e/2e6e931ea4c84af014ee30f54ba5f884/pa/RM24928_3b4b30c39e9ffdce5e01067963c0fea5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6/38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2711243,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/6e/2e6e931ea4c84af014ee30f54ba5f884/pa/RM24928_578f7eab6270ca79e999740a58b7a7db.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6/38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/6e/2e6e931ea4c84af014ee30f54ba5f884/pa/RM24928_21ca86df9c2b2c42a26cbe70fd4cb02e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6/38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2736750,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/6e/2e6e931ea4c84af014ee30f54ba5f884/pa/RM24928_f9fa4ef42f7a660b83fa921f4a01b0b5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6/38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/6e/2e6e931ea4c84af014ee30f54ba5f884/pa/RM24928_145843bca57d6d441a009bc3d824f3b4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ssangyong Korando 2.0 GPL Limited 4x2',
 'transmission': 'manual',
 'trim': 'Limited 4x2',
 'year': 2015}
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM24928%27 HTTP/1.1" 200 None
2026-03-28 12:05:27 [auto1.it] INFO: Saving data for RM24928: {'created_time': 1774699527.787276, 'last_price_update_time': 1774699527.787287, 'auction_closing_time': 1774885376.0}
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RM24928') HTTP/1.1" 204 0
2026-03-28 12:05:27 [auto1.it] INFO: Found listing with ID: YP53845
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YP53845%27 HTTP/1.1" 200 None
2026-03-28 12:05:27 [auto1.it] INFO: Scrape type for YP53845: 2
2026-03-28 12:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e54f4eb-6a12-51c2-8bbe-e4a64bf35028 with identifier: YP53845
2026-03-28 12:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e54f4eb-6a12-51c2-8bbe-e4a64bf35028 with scrape type 2
2026-03-28 12:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e54f4eb-6a12-51c2-8bbe-e4a64bf35028 with scrape type 2
2026-03-28 12:05:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1e54f4eb-6a12-51c2-8bbe-e4a64bf35028, identifier: YP53845
2026-03-28 12:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_e7f8ac0c220c6ca4abe2b61bdf21a39d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_e8bd537a10ed01b255b9f4f42f64b6b9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1e54f4eb-6a12-51c2-8bbe-e4a64bf35028 with identifier: YP53845
2026-03-28 12:05:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1e54f4eb-6a12-51c2-8bbe-e4a64bf35028 with identifier: YP53845
2026-03-28 12:05:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1e54f4eb-6a12-51c2-8bbe-e4a64bf35028 with identifier: YP53845 to the API
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:29:30Z',
 'fuel_type': 'petrol',
 'id': '1e54f4eb-6a12-51c2-8bbe-e4a64bf35028',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP53845',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 108451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-02',
 'seller_name': None,
 'title': 'MINI Countryman Cooper S ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2010}
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YP53845%27 HTTP/1.1" 200 None
2026-03-28 12:05:28 [auto1.it] INFO: Saving data for YP53845: {'auction_closing_time': 1774884570.0, 'created_time': 1774343240.609246, 'last_price_update_time': 1774699528.275656}
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YP53845') HTTP/1.1" 204 0
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F5b%252F235b7e2f4b8e4e0d718047316a1b4faf%252Fpa%252FKT14926_6cfb9c0bf7e088d579194644dceb1db3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/5b/235b7e2f4b8e4e0d718047316a1b4faf/pa/KT14926_6cfb9c0bf7e088d579194644dceb1db3.jpg not downloaded yet
2026-03-28 12:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SN56705> (referer: https://www.auto1.com/v1/car-details-view/SN56705/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JU86722/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DF57379> (referer: https://www.auto1.com/v1/car-details-view/DF57379/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:28 [auto1.it] INFO: Found listing with ID: MU44225
2026-03-28 12:05:28 [auto1.it] INFO: Found listing with ID: DV89996
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV89996%27 HTTP/1.1" 200 None
2026-03-28 12:05:28 [auto1.it] INFO: Scrape type for DV89996: 1
2026-03-28 12:05:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfce2d0>
2026-03-28 12:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_162bacd6-cf45-5c7b-b8fb-2349c890dad3/162bacd6-cf45-5c7b-b8fb-2349c890dad3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Ff4%252F69f426301771797af1096b611f3f27b5%252Fpa%252FZH08694_00a5d09bb5aa00473e91feaeed2bf604.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_00a5d09bb5aa00473e91feaeed2bf604.jpg saved to cache
2026-03-28 12:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 162bacd6-cf45-5c7b-b8fb-2349c890dad3
2026-03-28 12:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/5b/235b7e2f4b8e4e0d718047316a1b4faf/pa/KT14926_25db6fa1a5624d9446c782041b730578.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/5b/235b7e2f4b8e4e0d718047316a1b4faf/pa/KT14926_41d913f98c56c73276fd9e72e8135410.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:28 [auto1.it] INFO: Found listing with ID: GC21308
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC21308%27 HTTP/1.1" 200 None
2026-03-28 12:05:28 [auto1.it] INFO: Scrape type for GC21308: 1
2026-03-28 12:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bf28b2d0>
2026-03-28 12:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_515399f1-c951-5577-88f0-8b40f453c68e/515399f1-c951-5577-88f0-8b40f453c68e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd8%252Faed8d8d55f35b476d34c76ba49929d73%252Fpa%252FCS61296_e7f8ac0c220c6ca4abe2b61bdf21a39d.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_e7f8ac0c220c6ca4abe2b61bdf21a39d.jpg saved to cache
2026-03-28 12:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 515399f1-c951-5577-88f0-8b40f453c68e
2026-03-28 12:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfd0b10>
2026-03-28 12:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_162bacd6-cf45-5c7b-b8fb-2349c890dad3/162bacd6-cf45-5c7b-b8fb-2349c890dad3_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Ff4%252F69f426301771797af1096b611f3f27b5%252Fpa%252FZH08694_e8bd537a10ed01b255b9f4f42f64b6b9.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_e8bd537a10ed01b255b9f4f42f64b6b9.jpg saved to cache
2026-03-28 12:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 162bacd6-cf45-5c7b-b8fb-2349c890dad3
2026-03-28 12:05:28 [auto1.it] INFO: Found listing with ID: WN69179
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN69179%27 HTTP/1.1" 200 None
2026-03-28 12:05:28 [auto1.it] INFO: Scrape type for WN69179: 1
2026-03-28 12:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/5b/235b7e2f4b8e4e0d718047316a1b4faf/pa/KT14926_6b73083fb533e032e877b78e3668c317.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:28 [auto1.it] INFO: Found listing with ID: RT68139
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT68139%27 HTTP/1.1" 200 None
2026-03-28 12:05:28 [auto1.it] INFO: Scrape type for RT68139: 1
2026-03-28 12:05:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fe3a245-e334-53de-bcfa-d451fd57632f with identifier: SN56705
2026-03-28 12:05:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fe3a245-e334-53de-bcfa-d451fd57632f with scrape type 1
2026-03-28 12:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9fe3a245-e334-53de-bcfa-d451fd57632f
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F1a%252Ffd1a90ab084469d9ce6ea9be40acb2b3%252Fpa%252FSN56705_1d9f32171d0560829297b3d70e6dfbeb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/1a/fd1a90ab084469d9ce6ea9be40acb2b3/pa/SN56705_1d9f32171d0560829297b3d70e6dfbeb.jpg already downloaded
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F1a%252Ffd1a90ab084469d9ce6ea9be40acb2b3%252Fpa%252FSN56705_6c47d593bf8c0cb29b652f5d22984e45.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/1a/fd1a90ab084469d9ce6ea9be40acb2b3/pa/SN56705_6c47d593bf8c0cb29b652f5d22984e45.jpg already downloaded
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F1a%252Ffd1a90ab084469d9ce6ea9be40acb2b3%252Fpa%252FSN56705_ab28c4b6dbca19ebd21d79586860282f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/1a/fd1a90ab084469d9ce6ea9be40acb2b3/pa/SN56705_ab28c4b6dbca19ebd21d79586860282f.jpg already downloaded
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F1a%252Ffd1a90ab084469d9ce6ea9be40acb2b3%252Fpa%252FSN56705_2bc40ca4c16990f7c498c6bb6336c0b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/1a/fd1a90ab084469d9ce6ea9be40acb2b3/pa/SN56705_2bc40ca4c16990f7c498c6bb6336c0b1.jpg already downloaded
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F1a%252Ffd1a90ab084469d9ce6ea9be40acb2b3%252Fpa%252FSN56705_ecae9c7ee26970490f96a15c7aa31f52.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/1a/fd1a90ab084469d9ce6ea9be40acb2b3/pa/SN56705_ecae9c7ee26970490f96a15c7aa31f52.jpg already downloaded
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F1a%252Ffd1a90ab084469d9ce6ea9be40acb2b3%252Fpa%252FSN56705_96b6d99c3e6242bf428c18b21452ca3d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/1a/fd1a90ab084469d9ce6ea9be40acb2b3/pa/SN56705_96b6d99c3e6242bf428c18b21452ca3d.jpg already downloaded
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F1a%252Ffd1a90ab084469d9ce6ea9be40acb2b3%252Fpa%252FSN56705_4e28c9baee74dc20c6a1d782d867f8d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/1a/fd1a90ab084469d9ce6ea9be40acb2b3/pa/SN56705_4e28c9baee74dc20c6a1d782d867f8d1.jpg already downloaded
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F1a%252Ffd1a90ab084469d9ce6ea9be40acb2b3%252Fpa%252FSN56705_0daddf710ec73545ed6255ab4a0e56d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/1a/fd1a90ab084469d9ce6ea9be40acb2b3/pa/SN56705_0daddf710ec73545ed6255ab4a0e56d6.jpg already downloaded
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F1a%252Ffd1a90ab084469d9ce6ea9be40acb2b3%252Fpa%252FSN56705_94120c33f2153d6ec99a1a14b0ed31af.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/1a/fd1a90ab084469d9ce6ea9be40acb2b3/pa/SN56705_94120c33f2153d6ec99a1a14b0ed31af.jpg already downloaded
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F1a%252Ffd1a90ab084469d9ce6ea9be40acb2b3%252Fpa%252FSN56705_23fdc197c5f3baf345229ae3302c42d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/1a/fd1a90ab084469d9ce6ea9be40acb2b3/pa/SN56705_23fdc197c5f3baf345229ae3302c42d4.jpg already downloaded
2026-03-28 12:05:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9fe3a245-e334-53de-bcfa-d451fd57632f, identifier: SN56705
2026-03-28 12:05:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 786c1b3f-9ca3-50b5-a222-ea76f64826be with identifier: DF57379
2026-03-28 12:05:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 786c1b3f-9ca3-50b5-a222-ea76f64826be with scrape type 1
2026-03-28 12:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 786c1b3f-9ca3-50b5-a222-ea76f64826be
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F32%252F38325446e73ff1e5c087c0e62bc0c99c%252Fpa%252FDF57379_d5e7287d07d5b278be19ccbdb5891a14.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/32/38325446e73ff1e5c087c0e62bc0c99c/pa/DF57379_d5e7287d07d5b278be19ccbdb5891a14.jpg already downloaded
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F32%252F38325446e73ff1e5c087c0e62bc0c99c%252Fpa%252FDF57379_2d06fcc3709694eedbaa71c81ca8cbde.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/32/38325446e73ff1e5c087c0e62bc0c99c/pa/DF57379_2d06fcc3709694eedbaa71c81ca8cbde.jpg already downloaded
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F32%252F38325446e73ff1e5c087c0e62bc0c99c%252Fpa%252FDF57379_9ae03383f92908827eee16bb8c0f55f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/32/38325446e73ff1e5c087c0e62bc0c99c/pa/DF57379_9ae03383f92908827eee16bb8c0f55f6.jpg already downloaded
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F32%252F38325446e73ff1e5c087c0e62bc0c99c%252Fpa%252FDF57379_6a36f3f26e99a860ce0281e0f510a089.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/32/38325446e73ff1e5c087c0e62bc0c99c/pa/DF57379_6a36f3f26e99a860ce0281e0f510a089.jpg already downloaded
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F32%252F38325446e73ff1e5c087c0e62bc0c99c%252Fpa%252FDF57379_25d4cf17aff9b983e4d534d167297c08.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/32/38325446e73ff1e5c087c0e62bc0c99c/pa/DF57379_25d4cf17aff9b983e4d534d167297c08.jpg already downloaded
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F32%252F38325446e73ff1e5c087c0e62bc0c99c%252Fpa%252FDF57379_8ce8210671d82be299e3098456a36b1a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/32/38325446e73ff1e5c087c0e62bc0c99c/pa/DF57379_8ce8210671d82be299e3098456a36b1a.jpg already downloaded
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F32%252F38325446e73ff1e5c087c0e62bc0c99c%252Fpa%252FDF57379_ecfbf6b1de6840bca0ab3057caf15fe9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/32/38325446e73ff1e5c087c0e62bc0c99c/pa/DF57379_ecfbf6b1de6840bca0ab3057caf15fe9.jpg already downloaded
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F32%252F38325446e73ff1e5c087c0e62bc0c99c%252Fpa%252FDF57379_34bcc9be26e71e8cb548b0004303eccf.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/32/38325446e73ff1e5c087c0e62bc0c99c/pa/DF57379_34bcc9be26e71e8cb548b0004303eccf.jpg already downloaded
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F32%252F38325446e73ff1e5c087c0e62bc0c99c%252Fpa%252FDF57379_470516c45dc49fba29924ac10a4c955a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/32/38325446e73ff1e5c087c0e62bc0c99c/pa/DF57379_470516c45dc49fba29924ac10a4c955a.jpg already downloaded
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F32%252F38325446e73ff1e5c087c0e62bc0c99c%252Fpa%252FDF57379_4c0e912c6d3d54b9be79e3817ea79832.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/32/38325446e73ff1e5c087c0e62bc0c99c/pa/DF57379_4c0e912c6d3d54b9be79e3817ea79832.jpg already downloaded
2026-03-28 12:05:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 786c1b3f-9ca3-50b5-a222-ea76f64826be, identifier: DF57379
2026-03-28 12:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9fe3a245-e334-53de-bcfa-d451fd57632f with identifier: SN56705
2026-03-28 12:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:05:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-28 12:05:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9fe3a245-e334-53de-bcfa-d451fd57632f with identifier: SN56705
2026-03-28 12:05:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9fe3a245-e334-53de-bcfa-d451fd57632f with identifier: SN56705 to the API
2026-03-28 12:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SN56705>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '3.5L',
 'engine_horse_power': 313,
 'expiration_date': '2026-03-30T15:51:43Z',
 'fuel_type': 'hybrid',
 'id': '9fe3a245-e334-53de-bcfa-d451fd57632f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN56705',
 'listing': 'auction',
 'location': 'IT, Reggio Emilia',
 'make': 'Lexus',
 'model': 'RX-Serie',
 'odometer': 129187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgfd/1a/fd1a90ab084469d9ce6ea9be40acb2b3/pa/SN56705_1d9f32171d0560829297b3d70e6dfbeb.jpg',
                'https://img-pa.auto1.com/imgfd/1a/fd1a90ab084469d9ce6ea9be40acb2b3/pa/SN56705_6c47d593bf8c0cb29b652f5d22984e45.jpg',
                'https://img-pa.auto1.com/imgfd/1a/fd1a90ab084469d9ce6ea9be40acb2b3/pa/SN56705_ab28c4b6dbca19ebd21d79586860282f.jpg',
                'https://img-pa.auto1.com/imgfd/1a/fd1a90ab084469d9ce6ea9be40acb2b3/pa/SN56705_2bc40ca4c16990f7c498c6bb6336c0b1.jpg',
                'https://img-pa.auto1.com/imgfd/1a/fd1a90ab084469d9ce6ea9be40acb2b3/pa/SN56705_ecae9c7ee26970490f96a15c7aa31f52.jpg',
                'https://img-pa.auto1.com/imgfd/1a/fd1a90ab084469d9ce6ea9be40acb2b3/pa/SN56705_96b6d99c3e6242bf428c18b21452ca3d.jpg',
                'https://img-pa.auto1.com/imgfd/1a/fd1a90ab084469d9ce6ea9be40acb2b3/pa/SN56705_4e28c9baee74dc20c6a1d782d867f8d1.jpg',
                'https://img-pa.auto1.com/imgfd/1a/fd1a90ab084469d9ce6ea9be40acb2b3/pa/SN56705_0daddf710ec73545ed6255ab4a0e56d6.jpg',
                'https://img-pa.auto1.com/imgfd/1a/fd1a90ab084469d9ce6ea9be40acb2b3/pa/SN56705_94120c33f2153d6ec99a1a14b0ed31af.jpg',
                'https://img-pa.auto1.com/imgfd/1a/fd1a90ab084469d9ce6ea9be40acb2b3/pa/SN56705_23fdc197c5f3baf345229ae3302c42d4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fe3a245-e334-53de-bcfa-d451fd57632f/9fe3a245-e334-53de-bcfa-d451fd57632f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2633523,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/1a/fd1a90ab084469d9ce6ea9be40acb2b3/pa/SN56705_1d9f32171d0560829297b3d70e6dfbeb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fe3a245-e334-53de-bcfa-d451fd57632f/9fe3a245-e334-53de-bcfa-d451fd57632f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/1a/fd1a90ab084469d9ce6ea9be40acb2b3/pa/SN56705_6c47d593bf8c0cb29b652f5d22984e45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fe3a245-e334-53de-bcfa-d451fd57632f/9fe3a245-e334-53de-bcfa-d451fd57632f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/1a/fd1a90ab084469d9ce6ea9be40acb2b3/pa/SN56705_ab28c4b6dbca19ebd21d79586860282f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fe3a245-e334-53de-bcfa-d451fd57632f/9fe3a245-e334-53de-bcfa-d451fd57632f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2440204,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/1a/fd1a90ab084469d9ce6ea9be40acb2b3/pa/SN56705_2bc40ca4c16990f7c498c6bb6336c0b1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fe3a245-e334-53de-bcfa-d451fd57632f/9fe3a245-e334-53de-bcfa-d451fd57632f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/1a/fd1a90ab084469d9ce6ea9be40acb2b3/pa/SN56705_ecae9c7ee26970490f96a15c7aa31f52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fe3a245-e334-53de-bcfa-d451fd57632f/9fe3a245-e334-53de-bcfa-d451fd57632f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/1a/fd1a90ab084469d9ce6ea9be40acb2b3/pa/SN56705_96b6d99c3e6242bf428c18b21452ca3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fe3a245-e334-53de-bcfa-d451fd57632f/9fe3a245-e334-53de-bcfa-d451fd57632f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2494940,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/1a/fd1a90ab084469d9ce6ea9be40acb2b3/pa/SN56705_4e28c9baee74dc20c6a1d782d867f8d1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fe3a245-e334-53de-bcfa-d451fd57632f/9fe3a245-e334-53de-bcfa-d451fd57632f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/1a/fd1a90ab084469d9ce6ea9be40acb2b3/pa/SN56705_0daddf710ec73545ed6255ab4a0e56d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fe3a245-e334-53de-bcfa-d451fd57632f/9fe3a245-e334-53de-bcfa-d451fd57632f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2649079,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/1a/fd1a90ab084469d9ce6ea9be40acb2b3/pa/SN56705_94120c33f2153d6ec99a1a14b0ed31af.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fe3a245-e334-53de-bcfa-d451fd57632f/9fe3a245-e334-53de-bcfa-d451fd57632f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/1a/fd1a90ab084469d9ce6ea9be40acb2b3/pa/SN56705_23fdc197c5f3baf345229ae3302c42d4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lexus RX-Serie RX 450h Executive AWD',
 'transmission': 'automatic',
 'trim': 'Executive AWD',
 'year': 2019}
2026-03-28 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN56705%27 HTTP/1.1" 200 None
2026-03-28 12:05:29 [auto1.it] INFO: Saving data for SN56705: {'created_time': 1774699529.974112, 'last_price_update_time': 1774699529.974123, 'auction_closing_time': 1774885903.0}
2026-03-28 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SN56705') HTTP/1.1" 204 0
2026-03-28 12:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 786c1b3f-9ca3-50b5-a222-ea76f64826be with identifier: DF57379
2026-03-28 12:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 786c1b3f-9ca3-50b5-a222-ea76f64826be with identifier: DF57379
2026-03-28 12:05:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 786c1b3f-9ca3-50b5-a222-ea76f64826be with identifier: DF57379 to the API
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DF57379>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:35:43Z',
 'fuel_type': 'diesel',
 'id': '786c1b3f-9ca3-50b5-a222-ea76f64826be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF57379',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 139509,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img38/32/38325446e73ff1e5c087c0e62bc0c99c/pa/DF57379_d5e7287d07d5b278be19ccbdb5891a14.jpg',
                'https://img-pa.auto1.com/img38/32/38325446e73ff1e5c087c0e62bc0c99c/pa/DF57379_2d06fcc3709694eedbaa71c81ca8cbde.jpg',
                'https://img-pa.auto1.com/img38/32/38325446e73ff1e5c087c0e62bc0c99c/pa/DF57379_9ae03383f92908827eee16bb8c0f55f6.jpg',
                'https://img-pa.auto1.com/img38/32/38325446e73ff1e5c087c0e62bc0c99c/pa/DF57379_6a36f3f26e99a860ce0281e0f510a089.jpg',
                'https://img-pa.auto1.com/img38/32/38325446e73ff1e5c087c0e62bc0c99c/pa/DF57379_25d4cf17aff9b983e4d534d167297c08.jpg',
                'https://img-pa.auto1.com/img38/32/38325446e73ff1e5c087c0e62bc0c99c/pa/DF57379_8ce8210671d82be299e3098456a36b1a.jpg',
                'https://img-pa.auto1.com/img38/32/38325446e73ff1e5c087c0e62bc0c99c/pa/DF57379_ecfbf6b1de6840bca0ab3057caf15fe9.jpg',
                'https://img-pa.auto1.com/img38/32/38325446e73ff1e5c087c0e62bc0c99c/pa/DF57379_34bcc9be26e71e8cb548b0004303eccf.jpg',
                'https://img-pa.auto1.com/img38/32/38325446e73ff1e5c087c0e62bc0c99c/pa/DF57379_470516c45dc49fba29924ac10a4c955a.jpg',
                'https://img-pa.auto1.com/img38/32/38325446e73ff1e5c087c0e62bc0c99c/pa/DF57379_4c0e912c6d3d54b9be79e3817ea79832.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_786c1b3f-9ca3-50b5-a222-ea76f64826be/786c1b3f-9ca3-50b5-a222-ea76f64826be_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95634,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/32/38325446e73ff1e5c087c0e62bc0c99c/pa/DF57379_d5e7287d07d5b278be19ccbdb5891a14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_786c1b3f-9ca3-50b5-a222-ea76f64826be/786c1b3f-9ca3-50b5-a222-ea76f64826be_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3312027,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/32/38325446e73ff1e5c087c0e62bc0c99c/pa/DF57379_2d06fcc3709694eedbaa71c81ca8cbde.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_786c1b3f-9ca3-50b5-a222-ea76f64826be/786c1b3f-9ca3-50b5-a222-ea76f64826be_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2909513,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/32/38325446e73ff1e5c087c0e62bc0c99c/pa/DF57379_9ae03383f92908827eee16bb8c0f55f6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_786c1b3f-9ca3-50b5-a222-ea76f64826be/786c1b3f-9ca3-50b5-a222-ea76f64826be_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/32/38325446e73ff1e5c087c0e62bc0c99c/pa/DF57379_6a36f3f26e99a860ce0281e0f510a089.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_786c1b3f-9ca3-50b5-a222-ea76f64826be/786c1b3f-9ca3-50b5-a222-ea76f64826be_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/32/38325446e73ff1e5c087c0e62bc0c99c/pa/DF57379_25d4cf17aff9b983e4d534d167297c08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_786c1b3f-9ca3-50b5-a222-ea76f64826be/786c1b3f-9ca3-50b5-a222-ea76f64826be_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3370406,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/32/38325446e73ff1e5c087c0e62bc0c99c/pa/DF57379_8ce8210671d82be299e3098456a36b1a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_786c1b3f-9ca3-50b5-a222-ea76f64826be/786c1b3f-9ca3-50b5-a222-ea76f64826be_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3111879,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/32/38325446e73ff1e5c087c0e62bc0c99c/pa/DF57379_ecfbf6b1de6840bca0ab3057caf15fe9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_786c1b3f-9ca3-50b5-a222-ea76f64826be/786c1b3f-9ca3-50b5-a222-ea76f64826be_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3308916,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/32/38325446e73ff1e5c087c0e62bc0c99c/pa/DF57379_34bcc9be26e71e8cb548b0004303eccf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_786c1b3f-9ca3-50b5-a222-ea76f64826be/786c1b3f-9ca3-50b5-a222-ea76f64826be_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3441321,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/32/38325446e73ff1e5c087c0e62bc0c99c/pa/DF57379_470516c45dc49fba29924ac10a4c955a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_786c1b3f-9ca3-50b5-a222-ea76f64826be/786c1b3f-9ca3-50b5-a222-ea76f64826be_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/32/38325446e73ff1e5c087c0e62bc0c99c/pa/DF57379_4c0e912c6d3d54b9be79e3817ea79832.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF57379%27 HTTP/1.1" 200 None
2026-03-28 12:05:30 [auto1.it] INFO: Saving data for DF57379: {'created_time': 1774699530.547742, 'last_price_update_time': 1774699530.547756, 'auction_closing_time': 1774884943.0}
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DF57379') HTTP/1.1" 204 0
2026-03-28 12:05:30 [auto1.it] INFO: Found listing with ID: GU07540
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU07540%27 HTTP/1.1" 200 None
2026-03-28 12:05:30 [auto1.it] INFO: Scrape type for GU07540: 1
2026-03-28 12:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bef36190>
2026-03-28 12:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b51a8a2c-1974-5620-a637-684ee20c2e01/b51a8a2c-1974-5620-a637-684ee20c2e01_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F5b%252F235b7e2f4b8e4e0d718047316a1b4faf%252Fpa%252FKT14926_25db6fa1a5624d9446c782041b730578.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/5b/235b7e2f4b8e4e0d718047316a1b4faf/pa/KT14926_25db6fa1a5624d9446c782041b730578.jpg saved to cache
2026-03-28 12:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b51a8a2c-1974-5620-a637-684ee20c2e01
2026-03-28 12:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd0230d0>
2026-03-28 12:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b51a8a2c-1974-5620-a637-684ee20c2e01/b51a8a2c-1974-5620-a637-684ee20c2e01_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F5b%252F235b7e2f4b8e4e0d718047316a1b4faf%252Fpa%252FKT14926_41d913f98c56c73276fd9e72e8135410.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/5b/235b7e2f4b8e4e0d718047316a1b4faf/pa/KT14926_41d913f98c56c73276fd9e72e8135410.jpg saved to cache
2026-03-28 12:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b51a8a2c-1974-5620-a637-684ee20c2e01
2026-03-28 12:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/5b/235b7e2f4b8e4e0d718047316a1b4faf/pa/KT14926_ac9b09844c5b0beb3559e7b0124820ae.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SB06120/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VY27693/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CU74500/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:30 [auto1.it] INFO: Found listing with ID: BW81707
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW81707%27 HTTP/1.1" 200 None
2026-03-28 12:05:30 [auto1.it] INFO: Scrape type for BW81707: 1
2026-03-28 12:05:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ET22397/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfbd010>
2026-03-28 12:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b51a8a2c-1974-5620-a637-684ee20c2e01/b51a8a2c-1974-5620-a637-684ee20c2e01_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F5b%252F235b7e2f4b8e4e0d718047316a1b4faf%252Fpa%252FKT14926_6b73083fb533e032e877b78e3668c317.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/5b/235b7e2f4b8e4e0d718047316a1b4faf/pa/KT14926_6b73083fb533e032e877b78e3668c317.jpg saved to cache
2026-03-28 12:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b51a8a2c-1974-5620-a637-684ee20c2e01
2026-03-28 12:05:30 [auto1.it] INFO: Found listing with ID: MJ56294
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ56294%27 HTTP/1.1" 200 None
2026-03-28 12:05:30 [auto1.it] INFO: Scrape type for MJ56294: 1
2026-03-28 12:05:30 [auto1.it] INFO: Found listing with ID: ND60676
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ND60676%27 HTTP/1.1" 200 None
2026-03-28 12:05:30 [auto1.it] INFO: Scrape type for ND60676: 1
2026-03-28 12:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_eb7d90a6d8b77361341be1dca9be0fa5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_7aa443351fec4078250ec1ae89abdad8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:30 [auto1.it] INFO: Found listing with ID: RD34551
2026-03-28 12:05:30 [auto1.it] INFO: Found listing with ID: MX89615
2026-03-28 12:05:30 [auto1.it] INFO: Found listing with ID: DC79577
2026-03-28 12:05:30 [auto1.it] INFO: Found listing with ID: DF10030
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF10030%27 HTTP/1.1" 200 None
2026-03-28 12:05:30 [auto1.it] INFO: Scrape type for DF10030: 1
2026-03-28 12:05:30 [auto1.it] INFO: Found listing with ID: FJ19911
2026-03-28 12:05:30 [auto1.it] INFO: Found listing with ID: DP83591
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP83591%27 HTTP/1.1" 200 None
2026-03-28 12:05:30 [auto1.it] INFO: Scrape type for DP83591: 1
2026-03-28 12:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfd3b10>
2026-03-28 12:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b51a8a2c-1974-5620-a637-684ee20c2e01/b51a8a2c-1974-5620-a637-684ee20c2e01_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F5b%252F235b7e2f4b8e4e0d718047316a1b4faf%252Fpa%252FKT14926_ac9b09844c5b0beb3559e7b0124820ae.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/5b/235b7e2f4b8e4e0d718047316a1b4faf/pa/KT14926_ac9b09844c5b0beb3559e7b0124820ae.jpg saved to cache
2026-03-28 12:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b51a8a2c-1974-5620-a637-684ee20c2e01
2026-03-28 12:05:30 [auto1.it] INFO: Found listing with ID: RF53888
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF53888%27 HTTP/1.1" 200 None
2026-03-28 12:05:30 [auto1.it] INFO: Scrape type for RF53888: 2
2026-03-28 12:05:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 989429ba-1d83-53df-8b9b-db9e62477ae6 with identifier: RF53888
2026-03-28 12:05:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 989429ba-1d83-53df-8b9b-db9e62477ae6 with scrape type 2
2026-03-28 12:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 989429ba-1d83-53df-8b9b-db9e62477ae6 with scrape type 2
2026-03-28 12:05:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 989429ba-1d83-53df-8b9b-db9e62477ae6, identifier: RF53888
2026-03-28 12:05:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 989429ba-1d83-53df-8b9b-db9e62477ae6 with identifier: RF53888
2026-03-28 12:05:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 989429ba-1d83-53df-8b9b-db9e62477ae6 with identifier: RF53888
2026-03-28 12:05:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 989429ba-1d83-53df-8b9b-db9e62477ae6 with identifier: RF53888 to the API
2026-03-28 12:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:38:23Z',
 'fuel_type': 'diesel',
 'id': '989429ba-1d83-53df-8b9b-db9e62477ae6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF53888',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 211346,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-11',
 'seller_name': None,
 'title': 'BMW 5er 520d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-28 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF53888%27 HTTP/1.1" 200 None
2026-03-28 12:05:31 [auto1.it] INFO: Saving data for RF53888: {'auction_closing_time': 1774885103.0, 'created_time': 1774343258.340001, 'last_price_update_time': 1774699531.762229}
2026-03-28 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RF53888') HTTP/1.1" 204 0
2026-03-28 12:05:31 [auto1.it] INFO: Found listing with ID: XC35499
2026-03-28 12:05:31 [auto1.it] INFO: Found listing with ID: KW13943
2026-03-28 12:05:31 [auto1.it] INFO: Found listing with ID: CK02940
2026-03-28 12:05:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd03ffd0>
2026-03-28 12:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_515399f1-c951-5577-88f0-8b40f453c68e/515399f1-c951-5577-88f0-8b40f453c68e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd8%252Faed8d8d55f35b476d34c76ba49929d73%252Fpa%252FCS61296_eb7d90a6d8b77361341be1dca9be0fa5.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_eb7d90a6d8b77361341be1dca9be0fa5.jpg saved to cache
2026-03-28 12:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 515399f1-c951-5577-88f0-8b40f453c68e
2026-03-28 12:05:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd0fd850>
2026-03-28 12:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_515399f1-c951-5577-88f0-8b40f453c68e/515399f1-c951-5577-88f0-8b40f453c68e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd8%252Faed8d8d55f35b476d34c76ba49929d73%252Fpa%252FCS61296_7aa443351fec4078250ec1ae89abdad8.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_7aa443351fec4078250ec1ae89abdad8.jpg saved to cache
2026-03-28 12:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 515399f1-c951-5577-88f0-8b40f453c68e
2026-03-28 12:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RT10721> (referer: https://www.auto1.com/v1/car-details-view/RT10721/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BL56378> (referer: https://www.auto1.com/v1/car-details-view/BL56378/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ET05908/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 772039df-faed-5833-bbce-5cf1a5434400 with identifier: RT10721
2026-03-28 12:05:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 772039df-faed-5833-bbce-5cf1a5434400 with scrape type 1
2026-03-28 12:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 772039df-faed-5833-bbce-5cf1a5434400
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa5%252F0ba55a1242ab2fe27d210990dd45f67e%252Fpa%252FRT10721_e15ee0db54a58be24d3a6939270c1983.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a5/0ba55a1242ab2fe27d210990dd45f67e/pa/RT10721_e15ee0db54a58be24d3a6939270c1983.jpg already downloaded
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa5%252F0ba55a1242ab2fe27d210990dd45f67e%252Fpa%252FRT10721_97aa9b4328bcbb92d4ca3d531cfc44a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a5/0ba55a1242ab2fe27d210990dd45f67e/pa/RT10721_97aa9b4328bcbb92d4ca3d531cfc44a0.jpg already downloaded
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa5%252F0ba55a1242ab2fe27d210990dd45f67e%252Fpa%252FRT10721_7f820cb8458591e414166caccd1459fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a5/0ba55a1242ab2fe27d210990dd45f67e/pa/RT10721_7f820cb8458591e414166caccd1459fc.jpg already downloaded
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa5%252F0ba55a1242ab2fe27d210990dd45f67e%252Fpa%252FRT10721_a1716d204c4fe96ec9aa8e1ed7dd5752.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a5/0ba55a1242ab2fe27d210990dd45f67e/pa/RT10721_a1716d204c4fe96ec9aa8e1ed7dd5752.jpg already downloaded
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa5%252F0ba55a1242ab2fe27d210990dd45f67e%252Fpa%252FRT10721_12a24db6040098cc1c2490da6406fe33.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a5/0ba55a1242ab2fe27d210990dd45f67e/pa/RT10721_12a24db6040098cc1c2490da6406fe33.jpg already downloaded
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa5%252F0ba55a1242ab2fe27d210990dd45f67e%252Fpa%252FRT10721_77380b77bfbfe3f3f0254a729a346215.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a5/0ba55a1242ab2fe27d210990dd45f67e/pa/RT10721_77380b77bfbfe3f3f0254a729a346215.jpg already downloaded
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa5%252F0ba55a1242ab2fe27d210990dd45f67e%252Fpa%252FRT10721_b1a47111d65cf869594365e20e6b07bd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a5/0ba55a1242ab2fe27d210990dd45f67e/pa/RT10721_b1a47111d65cf869594365e20e6b07bd.jpg already downloaded
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa5%252F0ba55a1242ab2fe27d210990dd45f67e%252Fpa%252FRT10721_df635f4f6b0fe63da482d3c82102fccd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a5/0ba55a1242ab2fe27d210990dd45f67e/pa/RT10721_df635f4f6b0fe63da482d3c82102fccd.jpg already downloaded
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa5%252F0ba55a1242ab2fe27d210990dd45f67e%252Fpa%252FRT10721_cec49e5cab2ffbbef1fa8b803dad5d33.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a5/0ba55a1242ab2fe27d210990dd45f67e/pa/RT10721_cec49e5cab2ffbbef1fa8b803dad5d33.jpg already downloaded
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa5%252F0ba55a1242ab2fe27d210990dd45f67e%252Fpa%252FRT10721_a2ab65d217ba78fcc84f6801ba5ff788.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a5/0ba55a1242ab2fe27d210990dd45f67e/pa/RT10721_a2ab65d217ba78fcc84f6801ba5ff788.jpg already downloaded
2026-03-28 12:05:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 772039df-faed-5833-bbce-5cf1a5434400, identifier: RT10721
2026-03-28 12:05:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc64f1a0-7cc1-54f3-a24d-e5aac844053c with identifier: BL56378
2026-03-28 12:05:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc64f1a0-7cc1-54f3-a24d-e5aac844053c with scrape type 1
2026-03-28 12:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item dc64f1a0-7cc1-54f3-a24d-e5aac844053c
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fe2%252Fe2e2cfa46199d6bbfb1ccab0fbde8818%252Fpa%252FBL56378_fc0c8007dd751b333580283fc73811e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/e2/e2e2cfa46199d6bbfb1ccab0fbde8818/pa/BL56378_fc0c8007dd751b333580283fc73811e9.jpg already downloaded
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fe2%252Fe2e2cfa46199d6bbfb1ccab0fbde8818%252Fpa%252FBL56378_dca95da20ec2ad0e7d5175410e011b03.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/e2/e2e2cfa46199d6bbfb1ccab0fbde8818/pa/BL56378_dca95da20ec2ad0e7d5175410e011b03.jpg already downloaded
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fe2%252Fe2e2cfa46199d6bbfb1ccab0fbde8818%252Fpa%252FBL56378_d6fa8c3a42794fdfde177c45018bf3a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/e2/e2e2cfa46199d6bbfb1ccab0fbde8818/pa/BL56378_d6fa8c3a42794fdfde177c45018bf3a5.jpg already downloaded
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fe2%252Fe2e2cfa46199d6bbfb1ccab0fbde8818%252Fpa%252FBL56378_114d03ea77786598698c8aeb1adecb64.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/e2/e2e2cfa46199d6bbfb1ccab0fbde8818/pa/BL56378_114d03ea77786598698c8aeb1adecb64.jpg already downloaded
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fe2%252Fe2e2cfa46199d6bbfb1ccab0fbde8818%252Fpa%252FBL56378_f2c8f865d324f12060612456686e5aa6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/e2/e2e2cfa46199d6bbfb1ccab0fbde8818/pa/BL56378_f2c8f865d324f12060612456686e5aa6.jpg already downloaded
2026-03-28 12:05:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dc64f1a0-7cc1-54f3-a24d-e5aac844053c, identifier: BL56378
2026-03-28 12:05:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 772039df-faed-5833-bbce-5cf1a5434400 with identifier: RT10721
2026-03-28 12:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 772039df-faed-5833-bbce-5cf1a5434400 with identifier: RT10721
2026-03-28 12:05:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 772039df-faed-5833-bbce-5cf1a5434400 with identifier: RT10721 to the API
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RT10721>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:18:36Z',
 'fuel_type': 'diesel',
 'id': '772039df-faed-5833-bbce-5cf1a5434400',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT10721',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 401753,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img0b/a5/0ba55a1242ab2fe27d210990dd45f67e/pa/RT10721_e15ee0db54a58be24d3a6939270c1983.jpg',
                'https://img-pa.auto1.com/img0b/a5/0ba55a1242ab2fe27d210990dd45f67e/pa/RT10721_97aa9b4328bcbb92d4ca3d531cfc44a0.jpg',
                'https://img-pa.auto1.com/img0b/a5/0ba55a1242ab2fe27d210990dd45f67e/pa/RT10721_7f820cb8458591e414166caccd1459fc.jpg',
                'https://img-pa.auto1.com/img0b/a5/0ba55a1242ab2fe27d210990dd45f67e/pa/RT10721_a1716d204c4fe96ec9aa8e1ed7dd5752.jpg',
                'https://img-pa.auto1.com/img0b/a5/0ba55a1242ab2fe27d210990dd45f67e/pa/RT10721_12a24db6040098cc1c2490da6406fe33.jpg',
                'https://img-pa.auto1.com/img0b/a5/0ba55a1242ab2fe27d210990dd45f67e/pa/RT10721_77380b77bfbfe3f3f0254a729a346215.jpg',
                'https://img-pa.auto1.com/img0b/a5/0ba55a1242ab2fe27d210990dd45f67e/pa/RT10721_b1a47111d65cf869594365e20e6b07bd.jpg',
                'https://img-pa.auto1.com/img0b/a5/0ba55a1242ab2fe27d210990dd45f67e/pa/RT10721_df635f4f6b0fe63da482d3c82102fccd.jpg',
                'https://img-pa.auto1.com/img0b/a5/0ba55a1242ab2fe27d210990dd45f67e/pa/RT10721_cec49e5cab2ffbbef1fa8b803dad5d33.jpg',
                'https://img-pa.auto1.com/img0b/a5/0ba55a1242ab2fe27d210990dd45f67e/pa/RT10721_a2ab65d217ba78fcc84f6801ba5ff788.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_772039df-faed-5833-bbce-5cf1a5434400/772039df-faed-5833-bbce-5cf1a5434400_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2249903,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/a5/0ba55a1242ab2fe27d210990dd45f67e/pa/RT10721_e15ee0db54a58be24d3a6939270c1983.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_772039df-faed-5833-bbce-5cf1a5434400/772039df-faed-5833-bbce-5cf1a5434400_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2085908,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/a5/0ba55a1242ab2fe27d210990dd45f67e/pa/RT10721_97aa9b4328bcbb92d4ca3d531cfc44a0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_772039df-faed-5833-bbce-5cf1a5434400/772039df-faed-5833-bbce-5cf1a5434400_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2078606,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/a5/0ba55a1242ab2fe27d210990dd45f67e/pa/RT10721_7f820cb8458591e414166caccd1459fc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_772039df-faed-5833-bbce-5cf1a5434400/772039df-faed-5833-bbce-5cf1a5434400_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1900298,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/a5/0ba55a1242ab2fe27d210990dd45f67e/pa/RT10721_a1716d204c4fe96ec9aa8e1ed7dd5752.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_772039df-faed-5833-bbce-5cf1a5434400/772039df-faed-5833-bbce-5cf1a5434400_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2140760,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/a5/0ba55a1242ab2fe27d210990dd45f67e/pa/RT10721_12a24db6040098cc1c2490da6406fe33.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_772039df-faed-5833-bbce-5cf1a5434400/772039df-faed-5833-bbce-5cf1a5434400_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2199556,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/a5/0ba55a1242ab2fe27d210990dd45f67e/pa/RT10721_77380b77bfbfe3f3f0254a729a346215.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_772039df-faed-5833-bbce-5cf1a5434400/772039df-faed-5833-bbce-5cf1a5434400_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2066522,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/a5/0ba55a1242ab2fe27d210990dd45f67e/pa/RT10721_b1a47111d65cf869594365e20e6b07bd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_772039df-faed-5833-bbce-5cf1a5434400/772039df-faed-5833-bbce-5cf1a5434400_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2124165,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/a5/0ba55a1242ab2fe27d210990dd45f67e/pa/RT10721_df635f4f6b0fe63da482d3c82102fccd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_772039df-faed-5833-bbce-5cf1a5434400/772039df-faed-5833-bbce-5cf1a5434400_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2070053,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/a5/0ba55a1242ab2fe27d210990dd45f67e/pa/RT10721_cec49e5cab2ffbbef1fa8b803dad5d33.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_772039df-faed-5833-bbce-5cf1a5434400/772039df-faed-5833-bbce-5cf1a5434400_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2057225,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/a5/0ba55a1242ab2fe27d210990dd45f67e/pa/RT10721_a2ab65d217ba78fcc84f6801ba5ff788.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-07-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 Kinetic 2WD',
 'transmission': 'manual',
 'trim': 'Kinetic 2WD',
 'year': 2015}
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT10721%27 HTTP/1.1" 200 None
2026-03-28 12:05:33 [auto1.it] INFO: Saving data for RT10721: {'created_time': 1774699533.061962, 'last_price_update_time': 1774699533.06197, 'auction_closing_time': 1774883916.0}
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RT10721') HTTP/1.1" 204 0
2026-03-28 12:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dc64f1a0-7cc1-54f3-a24d-e5aac844053c with identifier: BL56378
2026-03-28 12:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dc64f1a0-7cc1-54f3-a24d-e5aac844053c with identifier: BL56378
2026-03-28 12:05:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dc64f1a0-7cc1-54f3-a24d-e5aac844053c with identifier: BL56378 to the API
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BL56378>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 2',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:55:26Z',
 'fuel_type': 'petrol',
 'id': 'dc64f1a0-7cc1-54f3-a24d-e5aac844053c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL56378',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Volkswagen',
 'model': 'Bora',
 'odometer': 115580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imge2/e2/e2e2cfa46199d6bbfb1ccab0fbde8818/pa/BL56378_fc0c8007dd751b333580283fc73811e9.jpg',
                'https://img-pa.auto1.com/imge2/e2/e2e2cfa46199d6bbfb1ccab0fbde8818/pa/BL56378_dca95da20ec2ad0e7d5175410e011b03.jpg',
                'https://img-pa.auto1.com/imge2/e2/e2e2cfa46199d6bbfb1ccab0fbde8818/pa/BL56378_d6fa8c3a42794fdfde177c45018bf3a5.jpg',
                'https://img-pa.auto1.com/imge2/e2/e2e2cfa46199d6bbfb1ccab0fbde8818/pa/BL56378_114d03ea77786598698c8aeb1adecb64.jpg',
                'https://img-pa.auto1.com/imge2/e2/e2e2cfa46199d6bbfb1ccab0fbde8818/pa/BL56378_f2c8f865d324f12060612456686e5aa6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc64f1a0-7cc1-54f3-a24d-e5aac844053c/dc64f1a0-7cc1-54f3-a24d-e5aac844053c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/e2/e2e2cfa46199d6bbfb1ccab0fbde8818/pa/BL56378_fc0c8007dd751b333580283fc73811e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc64f1a0-7cc1-54f3-a24d-e5aac844053c/dc64f1a0-7cc1-54f3-a24d-e5aac844053c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96621,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/e2/e2e2cfa46199d6bbfb1ccab0fbde8818/pa/BL56378_dca95da20ec2ad0e7d5175410e011b03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc64f1a0-7cc1-54f3-a24d-e5aac844053c/dc64f1a0-7cc1-54f3-a24d-e5aac844053c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/e2/e2e2cfa46199d6bbfb1ccab0fbde8818/pa/BL56378_d6fa8c3a42794fdfde177c45018bf3a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc64f1a0-7cc1-54f3-a24d-e5aac844053c/dc64f1a0-7cc1-54f3-a24d-e5aac844053c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/e2/e2e2cfa46199d6bbfb1ccab0fbde8818/pa/BL56378_114d03ea77786598698c8aeb1adecb64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc64f1a0-7cc1-54f3-a24d-e5aac844053c/dc64f1a0-7cc1-54f3-a24d-e5aac844053c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/e2/e2e2cfa46199d6bbfb1ccab0fbde8818/pa/BL56378_f2c8f865d324f12060612456686e5aa6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2000-10-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Bora 1.6',
 'transmission': 'manual',
 'trim': '',
 'year': 2000}
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL56378%27 HTTP/1.1" 200 None
2026-03-28 12:05:33 [auto1.it] INFO: Saving data for BL56378: {'created_time': 1774699533.387302, 'last_price_update_time': 1774699533.387312, 'auction_closing_time': 1774886126.0}
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BL56378') HTTP/1.1" 204 0
2026-03-28 12:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CE47539/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AY76833> (referer: https://www.auto1.com/v1/car-details-view/AY76833/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LN66513/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KM48378/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91bf022d-7d60-5a1a-80ee-3a1d403d3872 with identifier: AY76833
2026-03-28 12:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91bf022d-7d60-5a1a-80ee-3a1d403d3872 with scrape type 1
2026-03-28 12:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 91bf022d-7d60-5a1a-80ee-3a1d403d3872
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fb1%252F86b13e7fe20b0ac0511511fa2d3aaa00%252Fpa%252FAY76833_f803b2720e0746c5d2e1dadcdb62c28d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_f803b2720e0746c5d2e1dadcdb62c28d.jpg not downloaded yet
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fb1%252F86b13e7fe20b0ac0511511fa2d3aaa00%252Fpa%252FAY76833_d37de9ec972d08c9a4b988d987467110.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_d37de9ec972d08c9a4b988d987467110.jpg not downloaded yet
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fb1%252F86b13e7fe20b0ac0511511fa2d3aaa00%252Fpa%252FAY76833_a10647a8f3a1f9f7b37909754dbe4c35.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_a10647a8f3a1f9f7b37909754dbe4c35.jpg not downloaded yet
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fb1%252F86b13e7fe20b0ac0511511fa2d3aaa00%252Fpa%252FAY76833_85fc811e8875445706d36cf041267d25.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_85fc811e8875445706d36cf041267d25.jpg not downloaded yet
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fb1%252F86b13e7fe20b0ac0511511fa2d3aaa00%252Fpa%252FAY76833_999b5af6c33ae821ccf4d9a02d7a4151.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_999b5af6c33ae821ccf4d9a02d7a4151.jpg not downloaded yet
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fb1%252F86b13e7fe20b0ac0511511fa2d3aaa00%252Fpa%252FAY76833_ef4100e1e8490c811bb2ea3e6f4c6b0e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_ef4100e1e8490c811bb2ea3e6f4c6b0e.jpg not downloaded yet
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fb1%252F86b13e7fe20b0ac0511511fa2d3aaa00%252Fpa%252FAY76833_65189e563217790d6fe88fc55abef02d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_65189e563217790d6fe88fc55abef02d.jpg not downloaded yet
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fb1%252F86b13e7fe20b0ac0511511fa2d3aaa00%252Fpa%252FAY76833_0432e033078c3743028eb3bce796f4dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_0432e033078c3743028eb3bce796f4dc.jpg not downloaded yet
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fb1%252F86b13e7fe20b0ac0511511fa2d3aaa00%252Fpa%252FAY76833_1fef0c31893c95b81bae3dbc7d37b80d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_1fef0c31893c95b81bae3dbc7d37b80d.jpg not downloaded yet
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fb1%252F86b13e7fe20b0ac0511511fa2d3aaa00%252Fpa%252FAY76833_638e549b639ef7fd8c325f4a51328aae.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_638e549b639ef7fd8c325f4a51328aae.jpg not downloaded yet
2026-03-28 12:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WN69179/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CV60870> (referer: https://www.auto1.com/v1/car-details-view/CV60870/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GU07540/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GC21308/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JU86722> (referer: https://www.auto1.com/v1/car-details-view/JU86722/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28b19035-1a98-52a4-bb34-7fd2b6c422b5 with identifier: CV60870
2026-03-28 12:05:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28b19035-1a98-52a4-bb34-7fd2b6c422b5 with scrape type 1
2026-03-28 12:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 28b19035-1a98-52a4-bb34-7fd2b6c422b5
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Faa%252F3daa5f53f2b0726ca76409b66030e107%252Fpa%252FCV60870_179433bb7b2e874d3ede2c2d7ff9989d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/aa/3daa5f53f2b0726ca76409b66030e107/pa/CV60870_179433bb7b2e874d3ede2c2d7ff9989d.jpg not downloaded yet
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Faa%252F3daa5f53f2b0726ca76409b66030e107%252Fpa%252FCV60870_9de6d6356f8eeb93c8712bfadeb3be0b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/aa/3daa5f53f2b0726ca76409b66030e107/pa/CV60870_9de6d6356f8eeb93c8712bfadeb3be0b.jpg not downloaded yet
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Faa%252F3daa5f53f2b0726ca76409b66030e107%252Fpa%252FCV60870_cd3120b970bf390de37ffaf25168c155.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/aa/3daa5f53f2b0726ca76409b66030e107/pa/CV60870_cd3120b970bf390de37ffaf25168c155.jpg not downloaded yet
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Faa%252F3daa5f53f2b0726ca76409b66030e107%252Fpa%252FCV60870_b1bb4ce14348bb2973772b94441709ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/aa/3daa5f53f2b0726ca76409b66030e107/pa/CV60870_b1bb4ce14348bb2973772b94441709ec.jpg not downloaded yet
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Faa%252F3daa5f53f2b0726ca76409b66030e107%252Fpa%252FCV60870_56fb73dbd5086f16ba4a7393a941293d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/aa/3daa5f53f2b0726ca76409b66030e107/pa/CV60870_56fb73dbd5086f16ba4a7393a941293d.jpg not downloaded yet
2026-03-28 12:05:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 803a20cd-56da-5707-9157-7f6fa4ab38c3 with identifier: JU86722
2026-03-28 12:05:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 803a20cd-56da-5707-9157-7f6fa4ab38c3 with scrape type 1
2026-03-28 12:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 803a20cd-56da-5707-9157-7f6fa4ab38c3
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F81%252F4e8195060afb6255c1c8d8b6ce9cf0f1%252Fpa%252FJU86722_69101f405aae874133831fa3d6d65799.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_69101f405aae874133831fa3d6d65799.jpg not downloaded yet
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F81%252F4e8195060afb6255c1c8d8b6ce9cf0f1%252Fpa%252FJU86722_0352d4df3214479fa1b400d274a803ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_0352d4df3214479fa1b400d274a803ad.jpg not downloaded yet
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F81%252F4e8195060afb6255c1c8d8b6ce9cf0f1%252Fpa%252FJU86722_a7604b3a70b8bd7dd4df7593ed5ce09b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_a7604b3a70b8bd7dd4df7593ed5ce09b.jpg not downloaded yet
2026-03-28 12:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RT68139/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_1fef0c31893c95b81bae3dbc7d37b80d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F81%252F4e8195060afb6255c1c8d8b6ce9cf0f1%252Fpa%252FJU86722_b37718994f1102b0bcd08e97253612a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_b37718994f1102b0bcd08e97253612a3.jpg not downloaded yet
2026-03-28 12:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F81%252F4e8195060afb6255c1c8d8b6ce9cf0f1%252Fpa%252FJU86722_6c1741ddaa296e0be03977c96fe9daa1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_6c1741ddaa296e0be03977c96fe9daa1.jpg not downloaded yet
2026-03-28 12:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DV89996/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F81%252F4e8195060afb6255c1c8d8b6ce9cf0f1%252Fpa%252FJU86722_96034b46b740a62a86bdf8de2409274c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_96034b46b740a62a86bdf8de2409274c.jpg not downloaded yet
2026-03-28 12:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F81%252F4e8195060afb6255c1c8d8b6ce9cf0f1%252Fpa%252FJU86722_13f90d1c94b37276c794d80c4d6f05a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_13f90d1c94b37276c794d80c4d6f05a3.jpg not downloaded yet
2026-03-28 12:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_638e549b639ef7fd8c325f4a51328aae.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F81%252F4e8195060afb6255c1c8d8b6ce9cf0f1%252Fpa%252FJU86722_2bc5979351cf9e5be85402cd0f10bce8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_2bc5979351cf9e5be85402cd0f10bce8.jpg not downloaded yet
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F81%252F4e8195060afb6255c1c8d8b6ce9cf0f1%252Fpa%252FJU86722_44e4cc2b9cfa2db1ff187eba8c0e34ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_44e4cc2b9cfa2db1ff187eba8c0e34ec.jpg not downloaded yet
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F81%252F4e8195060afb6255c1c8d8b6ce9cf0f1%252Fpa%252FJU86722_6afcb990e5d1334b9442882062349dc3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_6afcb990e5d1334b9442882062349dc3.jpg not downloaded yet
2026-03-28 12:05:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd020b90>
2026-03-28 12:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bf022d-7d60-5a1a-80ee-3a1d403d3872/91bf022d-7d60-5a1a-80ee-3a1d403d3872_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fb1%252F86b13e7fe20b0ac0511511fa2d3aaa00%252Fpa%252FAY76833_1fef0c31893c95b81bae3dbc7d37b80d.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_1fef0c31893c95b81bae3dbc7d37b80d.jpg saved to cache
2026-03-28 12:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 91bf022d-7d60-5a1a-80ee-3a1d403d3872
2026-03-28 12:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_6c1741ddaa296e0be03977c96fe9daa1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_a7604b3a70b8bd7dd4df7593ed5ce09b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_0432e033078c3743028eb3bce796f4dc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc59ae10>
2026-03-28 12:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bf022d-7d60-5a1a-80ee-3a1d403d3872/91bf022d-7d60-5a1a-80ee-3a1d403d3872_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fb1%252F86b13e7fe20b0ac0511511fa2d3aaa00%252Fpa%252FAY76833_638e549b639ef7fd8c325f4a51328aae.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_638e549b639ef7fd8c325f4a51328aae.jpg saved to cache
2026-03-28 12:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 91bf022d-7d60-5a1a-80ee-3a1d403d3872
2026-03-28 12:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_0352d4df3214479fa1b400d274a803ad.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd073790>
2026-03-28 12:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_803a20cd-56da-5707-9157-7f6fa4ab38c3/803a20cd-56da-5707-9157-7f6fa4ab38c3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F81%252F4e8195060afb6255c1c8d8b6ce9cf0f1%252Fpa%252FJU86722_6c1741ddaa296e0be03977c96fe9daa1.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_6c1741ddaa296e0be03977c96fe9daa1.jpg saved to cache
2026-03-28 12:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 803a20cd-56da-5707-9157-7f6fa4ab38c3
2026-03-28 12:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd06b0d0>
2026-03-28 12:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_803a20cd-56da-5707-9157-7f6fa4ab38c3/803a20cd-56da-5707-9157-7f6fa4ab38c3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F81%252F4e8195060afb6255c1c8d8b6ce9cf0f1%252Fpa%252FJU86722_a7604b3a70b8bd7dd4df7593ed5ce09b.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_a7604b3a70b8bd7dd4df7593ed5ce09b.jpg saved to cache
2026-03-28 12:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 803a20cd-56da-5707-9157-7f6fa4ab38c3
2026-03-28 12:05:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf309d0>
2026-03-28 12:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bf022d-7d60-5a1a-80ee-3a1d403d3872/91bf022d-7d60-5a1a-80ee-3a1d403d3872_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fb1%252F86b13e7fe20b0ac0511511fa2d3aaa00%252Fpa%252FAY76833_0432e033078c3743028eb3bce796f4dc.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_0432e033078c3743028eb3bce796f4dc.jpg saved to cache
2026-03-28 12:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 91bf022d-7d60-5a1a-80ee-3a1d403d3872
2026-03-28 12:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_65189e563217790d6fe88fc55abef02d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_6afcb990e5d1334b9442882062349dc3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfd2f90>
2026-03-28 12:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_803a20cd-56da-5707-9157-7f6fa4ab38c3/803a20cd-56da-5707-9157-7f6fa4ab38c3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F81%252F4e8195060afb6255c1c8d8b6ce9cf0f1%252Fpa%252FJU86722_0352d4df3214479fa1b400d274a803ad.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_0352d4df3214479fa1b400d274a803ad.jpg saved to cache
2026-03-28 12:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 803a20cd-56da-5707-9157-7f6fa4ab38c3
2026-03-28 12:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_44e4cc2b9cfa2db1ff187eba8c0e34ec.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_13f90d1c94b37276c794d80c4d6f05a3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_2bc5979351cf9e5be85402cd0f10bce8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd011750>
2026-03-28 12:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bf022d-7d60-5a1a-80ee-3a1d403d3872/91bf022d-7d60-5a1a-80ee-3a1d403d3872_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fb1%252F86b13e7fe20b0ac0511511fa2d3aaa00%252Fpa%252FAY76833_65189e563217790d6fe88fc55abef02d.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_65189e563217790d6fe88fc55abef02d.jpg saved to cache
2026-03-28 12:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 91bf022d-7d60-5a1a-80ee-3a1d403d3872
2026-03-28 12:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd100b50>
2026-03-28 12:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_803a20cd-56da-5707-9157-7f6fa4ab38c3/803a20cd-56da-5707-9157-7f6fa4ab38c3_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F81%252F4e8195060afb6255c1c8d8b6ce9cf0f1%252Fpa%252FJU86722_6afcb990e5d1334b9442882062349dc3.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_6afcb990e5d1334b9442882062349dc3.jpg saved to cache
2026-03-28 12:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 803a20cd-56da-5707-9157-7f6fa4ab38c3
2026-03-28 12:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf7a610>
2026-03-28 12:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_803a20cd-56da-5707-9157-7f6fa4ab38c3/803a20cd-56da-5707-9157-7f6fa4ab38c3_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F81%252F4e8195060afb6255c1c8d8b6ce9cf0f1%252Fpa%252FJU86722_44e4cc2b9cfa2db1ff187eba8c0e34ec.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_44e4cc2b9cfa2db1ff187eba8c0e34ec.jpg saved to cache
2026-03-28 12:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 803a20cd-56da-5707-9157-7f6fa4ab38c3
2026-03-28 12:05:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5ec350>
2026-03-28 12:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_803a20cd-56da-5707-9157-7f6fa4ab38c3/803a20cd-56da-5707-9157-7f6fa4ab38c3_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F81%252F4e8195060afb6255c1c8d8b6ce9cf0f1%252Fpa%252FJU86722_13f90d1c94b37276c794d80c4d6f05a3.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_13f90d1c94b37276c794d80c4d6f05a3.jpg saved to cache
2026-03-28 12:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 803a20cd-56da-5707-9157-7f6fa4ab38c3
2026-03-28 12:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcebea90>
2026-03-28 12:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_803a20cd-56da-5707-9157-7f6fa4ab38c3/803a20cd-56da-5707-9157-7f6fa4ab38c3_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F81%252F4e8195060afb6255c1c8d8b6ce9cf0f1%252Fpa%252FJU86722_2bc5979351cf9e5be85402cd0f10bce8.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_2bc5979351cf9e5be85402cd0f10bce8.jpg saved to cache
2026-03-28 12:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 803a20cd-56da-5707-9157-7f6fa4ab38c3
2026-03-28 12:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_b37718994f1102b0bcd08e97253612a3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ET22397> (referer: https://www.auto1.com/v1/car-details-view/ET22397/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MJ56294/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ET05908> (referer: https://www.auto1.com/v1/car-details-view/ET05908/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CU74500> (referer: https://www.auto1.com/v1/car-details-view/CU74500/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VY27693> (referer: https://www.auto1.com/v1/car-details-view/VY27693/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_96034b46b740a62a86bdf8de2409274c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_69101f405aae874133831fa3d6d65799.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/aa/3daa5f53f2b0726ca76409b66030e107/pa/CV60870_cd3120b970bf390de37ffaf25168c155.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/aa/3daa5f53f2b0726ca76409b66030e107/pa/CV60870_56fb73dbd5086f16ba4a7393a941293d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/aa/3daa5f53f2b0726ca76409b66030e107/pa/CV60870_179433bb7b2e874d3ede2c2d7ff9989d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bce7fed0>
2026-03-28 12:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_803a20cd-56da-5707-9157-7f6fa4ab38c3/803a20cd-56da-5707-9157-7f6fa4ab38c3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F81%252F4e8195060afb6255c1c8d8b6ce9cf0f1%252Fpa%252FJU86722_b37718994f1102b0bcd08e97253612a3.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_b37718994f1102b0bcd08e97253612a3.jpg saved to cache
2026-03-28 12:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 803a20cd-56da-5707-9157-7f6fa4ab38c3
2026-03-28 12:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_999b5af6c33ae821ccf4d9a02d7a4151.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_85fc811e8875445706d36cf041267d25.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f005e36-16d3-5521-82dc-2e1786c34f8b with identifier: ET22397
2026-03-28 12:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f005e36-16d3-5521-82dc-2e1786c34f8b with scrape type 1
2026-03-28 12:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0f005e36-16d3-5521-82dc-2e1786c34f8b
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F9f%252Fbf9f3989c9a9f3e1d1be9d8f6ba100e0%252Fpa%252FET22397_e55530dcbd3da55513954fb98fe50c9e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_e55530dcbd3da55513954fb98fe50c9e.jpg not downloaded yet
2026-03-28 12:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0941f7ce-8192-5540-beaf-6361d966fc21 with identifier: ET05908
2026-03-28 12:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0941f7ce-8192-5540-beaf-6361d966fc21 with scrape type 1
2026-03-28 12:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 0941f7ce-8192-5540-beaf-6361d966fc21
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F92%252F73928da73745969342cf8ac13fbe47d4%252Fpa%252FET05908_f9d45a6559b448e66515c963d1b6c659.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/92/73928da73745969342cf8ac13fbe47d4/pa/ET05908_f9d45a6559b448e66515c963d1b6c659.jpg not downloaded yet
2026-03-28 12:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a0321c5-b70b-55b1-9c1f-b0b3da6ead16 with identifier: CU74500
2026-03-28 12:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a0321c5-b70b-55b1-9c1f-b0b3da6ead16 with scrape type 1
2026-03-28 12:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2a0321c5-b70b-55b1-9c1f-b0b3da6ead16
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fec%252Fa4ec08bd2de49deb4d54a54d60f78df1%252Fpa%252FCU74500_e0cc36bf01c7134fb5ee9df628bfabee.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/ec/a4ec08bd2de49deb4d54a54d60f78df1/pa/CU74500_e0cc36bf01c7134fb5ee9df628bfabee.jpg already downloaded
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fec%252Fa4ec08bd2de49deb4d54a54d60f78df1%252Fpa%252FCU74500_a9e8ce8fbe7446cb6cdd0a330a2efdb4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/ec/a4ec08bd2de49deb4d54a54d60f78df1/pa/CU74500_a9e8ce8fbe7446cb6cdd0a330a2efdb4.jpg already downloaded
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fec%252Fa4ec08bd2de49deb4d54a54d60f78df1%252Fpa%252FCU74500_60e5725ca5d3758df3928e6f239cc271.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/ec/a4ec08bd2de49deb4d54a54d60f78df1/pa/CU74500_60e5725ca5d3758df3928e6f239cc271.jpg already downloaded
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fec%252Fa4ec08bd2de49deb4d54a54d60f78df1%252Fpa%252FCU74500_0c73215bfd60bf7c4b5f391add648b24.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/ec/a4ec08bd2de49deb4d54a54d60f78df1/pa/CU74500_0c73215bfd60bf7c4b5f391add648b24.jpg already downloaded
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fec%252Fa4ec08bd2de49deb4d54a54d60f78df1%252Fpa%252FCU74500_a194f795be7e7cb0ea303a0367dd7b07.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/ec/a4ec08bd2de49deb4d54a54d60f78df1/pa/CU74500_a194f795be7e7cb0ea303a0367dd7b07.jpg already downloaded
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fec%252Fa4ec08bd2de49deb4d54a54d60f78df1%252Fpa%252FCU74500_79447e9a11e7c6d40cc03ffdf082d5c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/ec/a4ec08bd2de49deb4d54a54d60f78df1/pa/CU74500_79447e9a11e7c6d40cc03ffdf082d5c9.jpg already downloaded
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fec%252Fa4ec08bd2de49deb4d54a54d60f78df1%252Fpa%252FCU74500_9f313a9d9ca8432c62a9d4f10427a6ab.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/ec/a4ec08bd2de49deb4d54a54d60f78df1/pa/CU74500_9f313a9d9ca8432c62a9d4f10427a6ab.jpg already downloaded
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fec%252Fa4ec08bd2de49deb4d54a54d60f78df1%252Fpa%252FCU74500_17adc225fb0ab0221b0002c1532eebee.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/ec/a4ec08bd2de49deb4d54a54d60f78df1/pa/CU74500_17adc225fb0ab0221b0002c1532eebee.jpg already downloaded
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fec%252Fa4ec08bd2de49deb4d54a54d60f78df1%252Fpa%252FCU74500_350a37ddaff9998f82ffebbc5ab8c034.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/ec/a4ec08bd2de49deb4d54a54d60f78df1/pa/CU74500_350a37ddaff9998f82ffebbc5ab8c034.jpg already downloaded
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fec%252Fa4ec08bd2de49deb4d54a54d60f78df1%252Fpa%252FCU74500_a74ba3fc52719eb76f26f74582ab7ec8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/ec/a4ec08bd2de49deb4d54a54d60f78df1/pa/CU74500_a74ba3fc52719eb76f26f74582ab7ec8.jpg already downloaded
2026-03-28 12:05:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2a0321c5-b70b-55b1-9c1f-b0b3da6ead16, identifier: CU74500
2026-03-28 12:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e101787d-807d-5642-b1ac-827c628c6848 with identifier: VY27693
2026-03-28 12:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e101787d-807d-5642-b1ac-827c628c6848 with scrape type 1
2026-03-28 12:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e101787d-807d-5642-b1ac-827c628c6848
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166f747e54bfdda8ced80164d01af69%252Fpa%252FVY27693_6d0ff5593064e03ca32900660016e78b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_6d0ff5593064e03ca32900660016e78b.jpg not downloaded yet
2026-03-28 12:05:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc4fa210>
2026-03-28 12:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_803a20cd-56da-5707-9157-7f6fa4ab38c3/803a20cd-56da-5707-9157-7f6fa4ab38c3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F81%252F4e8195060afb6255c1c8d8b6ce9cf0f1%252Fpa%252FJU86722_96034b46b740a62a86bdf8de2409274c.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_96034b46b740a62a86bdf8de2409274c.jpg saved to cache
2026-03-28 12:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 803a20cd-56da-5707-9157-7f6fa4ab38c3
2026-03-28 12:05:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc55bd90>
2026-03-28 12:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_803a20cd-56da-5707-9157-7f6fa4ab38c3/803a20cd-56da-5707-9157-7f6fa4ab38c3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F81%252F4e8195060afb6255c1c8d8b6ce9cf0f1%252Fpa%252FJU86722_69101f405aae874133831fa3d6d65799.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_69101f405aae874133831fa3d6d65799.jpg saved to cache
2026-03-28 12:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 803a20cd-56da-5707-9157-7f6fa4ab38c3
2026-03-28 12:05:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 803a20cd-56da-5707-9157-7f6fa4ab38c3, skipping ID generation
2026-03-28 12:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 803a20cd-56da-5707-9157-7f6fa4ab38c3 with scrape type 1
2026-03-28 12:05:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 803a20cd-56da-5707-9157-7f6fa4ab38c3 sending to next pipeline
2026-03-28 12:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 803a20cd-56da-5707-9157-7f6fa4ab38c3, identifier: JU86722
2026-03-28 12:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2a0321c5-b70b-55b1-9c1f-b0b3da6ead16 with identifier: CU74500
2026-03-28 12:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2a0321c5-b70b-55b1-9c1f-b0b3da6ead16 with identifier: CU74500
2026-03-28 12:05:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2a0321c5-b70b-55b1-9c1f-b0b3da6ead16 with identifier: CU74500 to the API
2026-03-28 12:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CU74500>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:00:58Z',
 'fuel_type': 'petrol',
 'id': '2a0321c5-b70b-55b1-9c1f-b0b3da6ead16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU74500',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 89185,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imga4/ec/a4ec08bd2de49deb4d54a54d60f78df1/pa/CU74500_e0cc36bf01c7134fb5ee9df628bfabee.jpg',
                'https://img-pa.auto1.com/imga4/ec/a4ec08bd2de49deb4d54a54d60f78df1/pa/CU74500_a9e8ce8fbe7446cb6cdd0a330a2efdb4.jpg',
                'https://img-pa.auto1.com/imga4/ec/a4ec08bd2de49deb4d54a54d60f78df1/pa/CU74500_60e5725ca5d3758df3928e6f239cc271.jpg',
                'https://img-pa.auto1.com/imga4/ec/a4ec08bd2de49deb4d54a54d60f78df1/pa/CU74500_0c73215bfd60bf7c4b5f391add648b24.jpg',
                'https://img-pa.auto1.com/imga4/ec/a4ec08bd2de49deb4d54a54d60f78df1/pa/CU74500_a194f795be7e7cb0ea303a0367dd7b07.jpg',
                'https://img-pa.auto1.com/imga4/ec/a4ec08bd2de49deb4d54a54d60f78df1/pa/CU74500_79447e9a11e7c6d40cc03ffdf082d5c9.jpg',
                'https://img-pa.auto1.com/imga4/ec/a4ec08bd2de49deb4d54a54d60f78df1/pa/CU74500_9f313a9d9ca8432c62a9d4f10427a6ab.jpg',
                'https://img-pa.auto1.com/imga4/ec/a4ec08bd2de49deb4d54a54d60f78df1/pa/CU74500_17adc225fb0ab0221b0002c1532eebee.jpg',
                'https://img-pa.auto1.com/imga4/ec/a4ec08bd2de49deb4d54a54d60f78df1/pa/CU74500_350a37ddaff9998f82ffebbc5ab8c034.jpg',
                'https://img-pa.auto1.com/imga4/ec/a4ec08bd2de49deb4d54a54d60f78df1/pa/CU74500_a74ba3fc52719eb76f26f74582ab7ec8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a0321c5-b70b-55b1-9c1f-b0b3da6ead16/2a0321c5-b70b-55b1-9c1f-b0b3da6ead16_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/ec/a4ec08bd2de49deb4d54a54d60f78df1/pa/CU74500_e0cc36bf01c7134fb5ee9df628bfabee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a0321c5-b70b-55b1-9c1f-b0b3da6ead16/2a0321c5-b70b-55b1-9c1f-b0b3da6ead16_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/ec/a4ec08bd2de49deb4d54a54d60f78df1/pa/CU74500_a9e8ce8fbe7446cb6cdd0a330a2efdb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a0321c5-b70b-55b1-9c1f-b0b3da6ead16/2a0321c5-b70b-55b1-9c1f-b0b3da6ead16_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/ec/a4ec08bd2de49deb4d54a54d60f78df1/pa/CU74500_60e5725ca5d3758df3928e6f239cc271.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a0321c5-b70b-55b1-9c1f-b0b3da6ead16/2a0321c5-b70b-55b1-9c1f-b0b3da6ead16_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/ec/a4ec08bd2de49deb4d54a54d60f78df1/pa/CU74500_0c73215bfd60bf7c4b5f391add648b24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a0321c5-b70b-55b1-9c1f-b0b3da6ead16/2a0321c5-b70b-55b1-9c1f-b0b3da6ead16_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56769,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/ec/a4ec08bd2de49deb4d54a54d60f78df1/pa/CU74500_a194f795be7e7cb0ea303a0367dd7b07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a0321c5-b70b-55b1-9c1f-b0b3da6ead16/2a0321c5-b70b-55b1-9c1f-b0b3da6ead16_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65229,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/ec/a4ec08bd2de49deb4d54a54d60f78df1/pa/CU74500_79447e9a11e7c6d40cc03ffdf082d5c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a0321c5-b70b-55b1-9c1f-b0b3da6ead16/2a0321c5-b70b-55b1-9c1f-b0b3da6ead16_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/ec/a4ec08bd2de49deb4d54a54d60f78df1/pa/CU74500_9f313a9d9ca8432c62a9d4f10427a6ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a0321c5-b70b-55b1-9c1f-b0b3da6ead16/2a0321c5-b70b-55b1-9c1f-b0b3da6ead16_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61207,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/ec/a4ec08bd2de49deb4d54a54d60f78df1/pa/CU74500_17adc225fb0ab0221b0002c1532eebee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a0321c5-b70b-55b1-9c1f-b0b3da6ead16/2a0321c5-b70b-55b1-9c1f-b0b3da6ead16_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/ec/a4ec08bd2de49deb4d54a54d60f78df1/pa/CU74500_350a37ddaff9998f82ffebbc5ab8c034.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a0321c5-b70b-55b1-9c1f-b0b3da6ead16/2a0321c5-b70b-55b1-9c1f-b0b3da6ead16_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/ec/a4ec08bd2de49deb4d54a54d60f78df1/pa/CU74500_a74ba3fc52719eb76f26f74582ab7ec8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2011}
2026-03-28 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU74500%27 HTTP/1.1" 200 None
2026-03-28 12:05:36 [auto1.it] INFO: Saving data for CU74500: {'created_time': 1774699536.732754, 'last_price_update_time': 1774699536.732773, 'auction_closing_time': 1774882858.0}
2026-03-28 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CU74500') HTTP/1.1" 204 0
2026-03-28 12:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 803a20cd-56da-5707-9157-7f6fa4ab38c3 with identifier: JU86722
2026-03-28 12:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 803a20cd-56da-5707-9157-7f6fa4ab38c3 with identifier: JU86722
2026-03-28 12:05:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 803a20cd-56da-5707-9157-7f6fa4ab38c3 with identifier: JU86722 to the API
2026-03-28 12:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_69101f405aae874133831fa3d6d65799.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:11:40Z',
 'fuel_type': 'petrol',
 'id': '803a20cd-56da-5707-9157-7f6fa4ab38c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU86722',
 'listing': 'auction',
 'location': 'IT, Como',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 122322,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_803a20cd-56da-5707-9157-7f6fa4ab38c3/803a20cd-56da-5707-9157-7f6fa4ab38c3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2218228,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_69101f405aae874133831fa3d6d65799.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_803a20cd-56da-5707-9157-7f6fa4ab38c3/803a20cd-56da-5707-9157-7f6fa4ab38c3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_0352d4df3214479fa1b400d274a803ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_803a20cd-56da-5707-9157-7f6fa4ab38c3/803a20cd-56da-5707-9157-7f6fa4ab38c3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67121,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_a7604b3a70b8bd7dd4df7593ed5ce09b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_803a20cd-56da-5707-9157-7f6fa4ab38c3/803a20cd-56da-5707-9157-7f6fa4ab38c3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_b37718994f1102b0bcd08e97253612a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_803a20cd-56da-5707-9157-7f6fa4ab38c3/803a20cd-56da-5707-9157-7f6fa4ab38c3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_6c1741ddaa296e0be03977c96fe9daa1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_803a20cd-56da-5707-9157-7f6fa4ab38c3/803a20cd-56da-5707-9157-7f6fa4ab38c3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2315302,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_96034b46b740a62a86bdf8de2409274c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_803a20cd-56da-5707-9157-7f6fa4ab38c3/803a20cd-56da-5707-9157-7f6fa4ab38c3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2662446,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_13f90d1c94b37276c794d80c4d6f05a3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_803a20cd-56da-5707-9157-7f6fa4ab38c3/803a20cd-56da-5707-9157-7f6fa4ab38c3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_2bc5979351cf9e5be85402cd0f10bce8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_803a20cd-56da-5707-9157-7f6fa4ab38c3/803a20cd-56da-5707-9157-7f6fa4ab38c3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_44e4cc2b9cfa2db1ff187eba8c0e34ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_803a20cd-56da-5707-9157-7f6fa4ab38c3/803a20cd-56da-5707-9157-7f6fa4ab38c3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/81/4e8195060afb6255c1c8d8b6ce9cf0f1/pa/JU86722_6afcb990e5d1334b9442882062349dc3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-01-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 35 TFSI Mild-Hybrid advanced',
 'transmission': 'automatic',
 'trim': 'advanced',
 'year': 2022}
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU86722%27 HTTP/1.1" 200 None
2026-03-28 12:05:37 [auto1.it] INFO: Saving data for JU86722: {'created_time': 1774699537.132082, 'last_price_update_time': 1774699537.132092, 'auction_closing_time': 1774883500.0}
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JU86722') HTTP/1.1" 204 0
2026-03-28 12:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_ef4100e1e8490c811bb2ea3e6f4c6b0e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/aa/3daa5f53f2b0726ca76409b66030e107/pa/CV60870_b1bb4ce14348bb2973772b94441709ec.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F9f%252Fbf9f3989c9a9f3e1d1be9d8f6ba100e0%252Fpa%252FET22397_2615b885b84ffbd59c52d3438f400920.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_2615b885b84ffbd59c52d3438f400920.jpg not downloaded yet
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F92%252F73928da73745969342cf8ac13fbe47d4%252Fpa%252FET05908_244b3d373ef1eaeb9e546aa99681cafc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/92/73928da73745969342cf8ac13fbe47d4/pa/ET05908_244b3d373ef1eaeb9e546aa99681cafc.jpg not downloaded yet
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166f747e54bfdda8ced80164d01af69%252Fpa%252FVY27693_02ba9821f6c50442752007e7ae9219bd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_02ba9821f6c50442752007e7ae9219bd.jpg not downloaded yet
2026-03-28 12:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf20890>
2026-03-28 12:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28b19035-1a98-52a4-bb34-7fd2b6c422b5/28b19035-1a98-52a4-bb34-7fd2b6c422b5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Faa%252F3daa5f53f2b0726ca76409b66030e107%252Fpa%252FCV60870_cd3120b970bf390de37ffaf25168c155.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/aa/3daa5f53f2b0726ca76409b66030e107/pa/CV60870_cd3120b970bf390de37ffaf25168c155.jpg saved to cache
2026-03-28 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 28b19035-1a98-52a4-bb34-7fd2b6c422b5
2026-03-28 12:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/aa/3daa5f53f2b0726ca76409b66030e107/pa/CV60870_9de6d6356f8eeb93c8712bfadeb3be0b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SB06120> (referer: https://www.auto1.com/v1/car-details-view/SB06120/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DP83591/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F9f%252Fbf9f3989c9a9f3e1d1be9d8f6ba100e0%252Fpa%252FET22397_2f12aac290764a932c408217a2d8ad00.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_2f12aac290764a932c408217a2d8ad00.jpg not downloaded yet
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F92%252F73928da73745969342cf8ac13fbe47d4%252Fpa%252FET05908_6f1c72f2025e24fd12d39d0b6e0ce5ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/92/73928da73745969342cf8ac13fbe47d4/pa/ET05908_6f1c72f2025e24fd12d39d0b6e0ce5ad.jpg not downloaded yet
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166f747e54bfdda8ced80164d01af69%252Fpa%252FVY27693_3f5079f8bb89adf752938f8f71623f43.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_3f5079f8bb89adf752938f8f71623f43.jpg not downloaded yet
2026-03-28 12:05:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ND60676/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc376250>
2026-03-28 12:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28b19035-1a98-52a4-bb34-7fd2b6c422b5/28b19035-1a98-52a4-bb34-7fd2b6c422b5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Faa%252F3daa5f53f2b0726ca76409b66030e107%252Fpa%252FCV60870_56fb73dbd5086f16ba4a7393a941293d.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/aa/3daa5f53f2b0726ca76409b66030e107/pa/CV60870_56fb73dbd5086f16ba4a7393a941293d.jpg saved to cache
2026-03-28 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 28b19035-1a98-52a4-bb34-7fd2b6c422b5
2026-03-28 12:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bf1baf90>
2026-03-28 12:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28b19035-1a98-52a4-bb34-7fd2b6c422b5/28b19035-1a98-52a4-bb34-7fd2b6c422b5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Faa%252F3daa5f53f2b0726ca76409b66030e107%252Fpa%252FCV60870_179433bb7b2e874d3ede2c2d7ff9989d.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/aa/3daa5f53f2b0726ca76409b66030e107/pa/CV60870_179433bb7b2e874d3ede2c2d7ff9989d.jpg saved to cache
2026-03-28 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 28b19035-1a98-52a4-bb34-7fd2b6c422b5
2026-03-28 12:05:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc562310>
2026-03-28 12:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bf022d-7d60-5a1a-80ee-3a1d403d3872/91bf022d-7d60-5a1a-80ee-3a1d403d3872_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fb1%252F86b13e7fe20b0ac0511511fa2d3aaa00%252Fpa%252FAY76833_999b5af6c33ae821ccf4d9a02d7a4151.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_999b5af6c33ae821ccf4d9a02d7a4151.jpg saved to cache
2026-03-28 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 91bf022d-7d60-5a1a-80ee-3a1d403d3872
2026-03-28 12:05:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf8be90>
2026-03-28 12:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bf022d-7d60-5a1a-80ee-3a1d403d3872/91bf022d-7d60-5a1a-80ee-3a1d403d3872_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fb1%252F86b13e7fe20b0ac0511511fa2d3aaa00%252Fpa%252FAY76833_85fc811e8875445706d36cf041267d25.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_85fc811e8875445706d36cf041267d25.jpg saved to cache
2026-03-28 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 91bf022d-7d60-5a1a-80ee-3a1d403d3872
2026-03-28 12:05:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc564710>
2026-03-28 12:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bf022d-7d60-5a1a-80ee-3a1d403d3872/91bf022d-7d60-5a1a-80ee-3a1d403d3872_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fb1%252F86b13e7fe20b0ac0511511fa2d3aaa00%252Fpa%252FAY76833_ef4100e1e8490c811bb2ea3e6f4c6b0e.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_ef4100e1e8490c811bb2ea3e6f4c6b0e.jpg saved to cache
2026-03-28 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 91bf022d-7d60-5a1a-80ee-3a1d403d3872
2026-03-28 12:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc544cd0>
2026-03-28 12:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28b19035-1a98-52a4-bb34-7fd2b6c422b5/28b19035-1a98-52a4-bb34-7fd2b6c422b5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Faa%252F3daa5f53f2b0726ca76409b66030e107%252Fpa%252FCV60870_b1bb4ce14348bb2973772b94441709ec.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/aa/3daa5f53f2b0726ca76409b66030e107/pa/CV60870_b1bb4ce14348bb2973772b94441709ec.jpg saved to cache
2026-03-28 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 28b19035-1a98-52a4-bb34-7fd2b6c422b5
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F9f%252Fbf9f3989c9a9f3e1d1be9d8f6ba100e0%252Fpa%252FET22397_ecfa660b52ca810aa5cf70d7c1bfe623.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_ecfa660b52ca810aa5cf70d7c1bfe623.jpg not downloaded yet
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F92%252F73928da73745969342cf8ac13fbe47d4%252Fpa%252FET05908_8af6e3ad1ce8414feb9934ffd9e1f1e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/92/73928da73745969342cf8ac13fbe47d4/pa/ET05908_8af6e3ad1ce8414feb9934ffd9e1f1e3.jpg not downloaded yet
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166f747e54bfdda8ced80164d01af69%252Fpa%252FVY27693_c93e57157d4a3821f74b53783294774f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_c93e57157d4a3821f74b53783294774f.jpg not downloaded yet
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F9f%252Fbf9f3989c9a9f3e1d1be9d8f6ba100e0%252Fpa%252FET22397_4259e323bd1a77452e9323633d537969.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_4259e323bd1a77452e9323633d537969.jpg not downloaded yet
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F92%252F73928da73745969342cf8ac13fbe47d4%252Fpa%252FET05908_2ce948899f2c046305ba0428a354ff7a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/92/73928da73745969342cf8ac13fbe47d4/pa/ET05908_2ce948899f2c046305ba0428a354ff7a.jpg not downloaded yet
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166f747e54bfdda8ced80164d01af69%252Fpa%252FVY27693_5d7af63742baed0abcab42ba1f27fa7f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_5d7af63742baed0abcab42ba1f27fa7f.jpg not downloaded yet
2026-03-28 12:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DF10030/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf630d0>
2026-03-28 12:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28b19035-1a98-52a4-bb34-7fd2b6c422b5/28b19035-1a98-52a4-bb34-7fd2b6c422b5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Faa%252F3daa5f53f2b0726ca76409b66030e107%252Fpa%252FCV60870_9de6d6356f8eeb93c8712bfadeb3be0b.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/aa/3daa5f53f2b0726ca76409b66030e107/pa/CV60870_9de6d6356f8eeb93c8712bfadeb3be0b.jpg saved to cache
2026-03-28 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 28b19035-1a98-52a4-bb34-7fd2b6c422b5
2026-03-28 12:05:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 28b19035-1a98-52a4-bb34-7fd2b6c422b5, skipping ID generation
2026-03-28 12:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28b19035-1a98-52a4-bb34-7fd2b6c422b5 with scrape type 1
2026-03-28 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 28b19035-1a98-52a4-bb34-7fd2b6c422b5 sending to next pipeline
2026-03-28 12:05:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 28b19035-1a98-52a4-bb34-7fd2b6c422b5, identifier: CV60870
2026-03-28 12:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dcf2a9c-dbdc-5011-830a-9f40907f3173 with identifier: SB06120
2026-03-28 12:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dcf2a9c-dbdc-5011-830a-9f40907f3173 with scrape type 1
2026-03-28 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5dcf2a9c-dbdc-5011-830a-9f40907f3173
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff9%252F35f9837c493f6daf1a433b99a731a16d%252Fpa%252FSB06120_78ba02911be7d82e8b8c772bce571c97.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_78ba02911be7d82e8b8c772bce571c97.jpg not downloaded yet
2026-03-28 12:05:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 28b19035-1a98-52a4-bb34-7fd2b6c422b5 with identifier: CV60870
2026-03-28 12:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 28b19035-1a98-52a4-bb34-7fd2b6c422b5 with identifier: CV60870
2026-03-28 12:05:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 28b19035-1a98-52a4-bb34-7fd2b6c422b5 with identifier: CV60870 to the API
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3d/aa/3daa5f53f2b0726ca76409b66030e107/pa/CV60870_9de6d6356f8eeb93c8712bfadeb3be0b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.7L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:04:30Z',
 'fuel_type': 'diesel',
 'id': '28b19035-1a98-52a4-bb34-7fd2b6c422b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV60870',
 'listing': 'auction',
 'location': 'IT, Camerano (AN)',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 304018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b19035-1a98-52a4-bb34-7fd2b6c422b5/28b19035-1a98-52a4-bb34-7fd2b6c422b5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/aa/3daa5f53f2b0726ca76409b66030e107/pa/CV60870_179433bb7b2e874d3ede2c2d7ff9989d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b19035-1a98-52a4-bb34-7fd2b6c422b5/28b19035-1a98-52a4-bb34-7fd2b6c422b5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/aa/3daa5f53f2b0726ca76409b66030e107/pa/CV60870_9de6d6356f8eeb93c8712bfadeb3be0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b19035-1a98-52a4-bb34-7fd2b6c422b5/28b19035-1a98-52a4-bb34-7fd2b6c422b5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/aa/3daa5f53f2b0726ca76409b66030e107/pa/CV60870_cd3120b970bf390de37ffaf25168c155.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b19035-1a98-52a4-bb34-7fd2b6c422b5/28b19035-1a98-52a4-bb34-7fd2b6c422b5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/aa/3daa5f53f2b0726ca76409b66030e107/pa/CV60870_b1bb4ce14348bb2973772b94441709ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b19035-1a98-52a4-bb34-7fd2b6c422b5/28b19035-1a98-52a4-bb34-7fd2b6c422b5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/aa/3daa5f53f2b0726ca76409b66030e107/pa/CV60870_56fb73dbd5086f16ba4a7393a941293d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-04-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 2.7 V6 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV60870%27 HTTP/1.1" 200 None
2026-03-28 12:05:38 [auto1.it] INFO: Saving data for CV60870: {'created_time': 1774699538.51216, 'last_price_update_time': 1774699538.51217, 'auction_closing_time': 1774883070.0}
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CV60870') HTTP/1.1" 204 0
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F9f%252Fbf9f3989c9a9f3e1d1be9d8f6ba100e0%252Fpa%252FET22397_a4c0c27d827afe18c5890114066de48a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_a4c0c27d827afe18c5890114066de48a.jpg not downloaded yet
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166f747e54bfdda8ced80164d01af69%252Fpa%252FVY27693_8be329bdba306f4c755279a6cbd6c797.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_8be329bdba306f4c755279a6cbd6c797.jpg not downloaded yet
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff9%252F35f9837c493f6daf1a433b99a731a16d%252Fpa%252FSB06120_1cd92b84b0bf579af340ab40ab8e171b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_1cd92b84b0bf579af340ab40ab8e171b.jpg not downloaded yet
2026-03-28 12:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GC21308> (referer: https://www.auto1.com/v1/car-details-view/GC21308/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RT68139> (referer: https://www.auto1.com/v1/car-details-view/RT68139/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WN69179> (referer: https://www.auto1.com/v1/car-details-view/WN69179/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F9f%252Fbf9f3989c9a9f3e1d1be9d8f6ba100e0%252Fpa%252FET22397_f08c6be3580ae3fa32690e259a75a159.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_f08c6be3580ae3fa32690e259a75a159.jpg not downloaded yet
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166f747e54bfdda8ced80164d01af69%252Fpa%252FVY27693_80c67501bf8191431b8ced6d24522e51.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_80c67501bf8191431b8ced6d24522e51.jpg not downloaded yet
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff9%252F35f9837c493f6daf1a433b99a731a16d%252Fpa%252FSB06120_4a4d37b82a0d7d2eaffab8489c435f91.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_4a4d37b82a0d7d2eaffab8489c435f91.jpg not downloaded yet
2026-03-28 12:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DV89996> (referer: https://www.auto1.com/v1/car-details-view/DV89996/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_c93e57157d4a3821f74b53783294774f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_ecfa660b52ca810aa5cf70d7c1bfe623.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/92/73928da73745969342cf8ac13fbe47d4/pa/ET05908_8af6e3ad1ce8414feb9934ffd9e1f1e3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F9f%252Fbf9f3989c9a9f3e1d1be9d8f6ba100e0%252Fpa%252FET22397_12f5724cd24a6faa8e59baf2fa0a4278.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_12f5724cd24a6faa8e59baf2fa0a4278.jpg not downloaded yet
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166f747e54bfdda8ced80164d01af69%252Fpa%252FVY27693_5c6a216fb2a03d66bb6c90961206ccee.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_5c6a216fb2a03d66bb6c90961206ccee.jpg not downloaded yet
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff9%252F35f9837c493f6daf1a433b99a731a16d%252Fpa%252FSB06120_23c4976bb91a40aae15430ce80f486dd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_23c4976bb91a40aae15430ce80f486dd.jpg not downloaded yet
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F9f%252Fbf9f3989c9a9f3e1d1be9d8f6ba100e0%252Fpa%252FET22397_f43f5296d00689daf6149ca87d5c84de.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_f43f5296d00689daf6149ca87d5c84de.jpg not downloaded yet
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166f747e54bfdda8ced80164d01af69%252Fpa%252FVY27693_9eb800c8c0ff9e13e7a81f2d1e83925f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_9eb800c8c0ff9e13e7a81f2d1e83925f.jpg not downloaded yet
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff9%252F35f9837c493f6daf1a433b99a731a16d%252Fpa%252FSB06120_8773dda2c8fb99fb00617af524941371.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_8773dda2c8fb99fb00617af524941371.jpg not downloaded yet
2026-03-28 12:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/92/73928da73745969342cf8ac13fbe47d4/pa/ET05908_6f1c72f2025e24fd12d39d0b6e0ce5ad.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_2615b885b84ffbd59c52d3438f400920.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F9f%252Fbf9f3989c9a9f3e1d1be9d8f6ba100e0%252Fpa%252FET22397_e520b26b6789838c3a70583738350672.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_e520b26b6789838c3a70583738350672.jpg not downloaded yet
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166f747e54bfdda8ced80164d01af69%252Fpa%252FVY27693_18dcabc0e381dc319beede3c922bec20.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_18dcabc0e381dc319beede3c922bec20.jpg not downloaded yet
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff9%252F35f9837c493f6daf1a433b99a731a16d%252Fpa%252FSB06120_c6365aef697e3b92702acca80d6e3504.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_c6365aef697e3b92702acca80d6e3504.jpg not downloaded yet
2026-03-28 12:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97978bda-0d93-5484-92c8-f1ce53e9d5c2 with identifier: GC21308
2026-03-28 12:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97978bda-0d93-5484-92c8-f1ce53e9d5c2 with scrape type 1
2026-03-28 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 97978bda-0d93-5484-92c8-f1ce53e9d5c2
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F8f%252F4f8f3f6e53cc88a9863b8359d559eb36%252Fpa%252FGC21308_e939c748ea1e415841e2f7f36f237aba.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_e939c748ea1e415841e2f7f36f237aba.jpg not downloaded yet
2026-03-28 12:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd with identifier: RT68139
2026-03-28 12:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd with scrape type 1
2026-03-28 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F00%252F1900fee19e0209ec751035b1964e0511%252Fpa%252FRT68139_439a724e2f561c19aae59e8df4cbfabc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_439a724e2f561c19aae59e8df4cbfabc.jpg not downloaded yet
2026-03-28 12:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4fa818f-fb69-545b-978b-23bcaecd0161 with identifier: WN69179
2026-03-28 12:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4fa818f-fb69-545b-978b-23bcaecd0161 with scrape type 1
2026-03-28 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a4fa818f-fb69-545b-978b-23bcaecd0161
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F96%252F0f9646a6cfd213c4cee53277aa5b9b3d%252Fpa%252FWN69179_7c4a903623fcee5fdc79d63909a19e40.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/96/0f9646a6cfd213c4cee53277aa5b9b3d/pa/WN69179_7c4a903623fcee5fdc79d63909a19e40.jpg not downloaded yet
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff9%252F35f9837c493f6daf1a433b99a731a16d%252Fpa%252FSB06120_5c7ca62904cd691e8fa3e3ed999bfce9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_5c7ca62904cd691e8fa3e3ed999bfce9.jpg not downloaded yet
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F8f%252F4f8f3f6e53cc88a9863b8359d559eb36%252Fpa%252FGC21308_b49d0e2684112026d9cf32ea0a4461f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_b49d0e2684112026d9cf32ea0a4461f3.jpg not downloaded yet
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F00%252F1900fee19e0209ec751035b1964e0511%252Fpa%252FRT68139_da172acf9b758d08fcb9831f114ad9e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_da172acf9b758d08fcb9831f114ad9e2.jpg not downloaded yet
2026-03-28 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F96%252F0f9646a6cfd213c4cee53277aa5b9b3d%252Fpa%252FWN69179_3d063739835f34fcaecddb48888c8cb6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/96/0f9646a6cfd213c4cee53277aa5b9b3d/pa/WN69179_3d063739835f34fcaecddb48888c8cb6.jpg not downloaded yet
2026-03-28 12:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a25493cd-b05c-5c17-bb7e-d0612eb87950 with identifier: DV89996
2026-03-28 12:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a25493cd-b05c-5c17-bb7e-d0612eb87950 with scrape type 1
2026-03-28 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a25493cd-b05c-5c17-bb7e-d0612eb87950
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F0e%252F130ebbfce184e74e638ea48458bb89c7%252Fpa%252FDV89996_9c1004a567a76a154d12e94be65adede.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/0e/130ebbfce184e74e638ea48458bb89c7/pa/DV89996_9c1004a567a76a154d12e94be65adede.jpg already downloaded
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F0e%252F130ebbfce184e74e638ea48458bb89c7%252Fpa%252FDV89996_66489152e705fd618f411c92f498018f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/0e/130ebbfce184e74e638ea48458bb89c7/pa/DV89996_66489152e705fd618f411c92f498018f.jpg already downloaded
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F0e%252F130ebbfce184e74e638ea48458bb89c7%252Fpa%252FDV89996_b2775f5f4132a851cfff777cc015254f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/0e/130ebbfce184e74e638ea48458bb89c7/pa/DV89996_b2775f5f4132a851cfff777cc015254f.jpg already downloaded
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F0e%252F130ebbfce184e74e638ea48458bb89c7%252Fpa%252FDV89996_e029bba55772059a2ad5a26b02fd7bcb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/0e/130ebbfce184e74e638ea48458bb89c7/pa/DV89996_e029bba55772059a2ad5a26b02fd7bcb.jpg already downloaded
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F0e%252F130ebbfce184e74e638ea48458bb89c7%252Fpa%252FDV89996_debfb8404e5667379f5b84615d23f535.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/0e/130ebbfce184e74e638ea48458bb89c7/pa/DV89996_debfb8404e5667379f5b84615d23f535.jpg already downloaded
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F0e%252F130ebbfce184e74e638ea48458bb89c7%252Fpa%252FDV89996_90331da6737d7ac203526adf58bbb918.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/0e/130ebbfce184e74e638ea48458bb89c7/pa/DV89996_90331da6737d7ac203526adf58bbb918.jpg already downloaded
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F0e%252F130ebbfce184e74e638ea48458bb89c7%252Fpa%252FDV89996_31a568b5ee06c664da17739bccc184b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/0e/130ebbfce184e74e638ea48458bb89c7/pa/DV89996_31a568b5ee06c664da17739bccc184b9.jpg already downloaded
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F0e%252F130ebbfce184e74e638ea48458bb89c7%252Fpa%252FDV89996_79cd9bd9cbac58e8de2c32089a56acb9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/0e/130ebbfce184e74e638ea48458bb89c7/pa/DV89996_79cd9bd9cbac58e8de2c32089a56acb9.jpg already downloaded
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F0e%252F130ebbfce184e74e638ea48458bb89c7%252Fpa%252FDV89996_45f7463e0740bef1b4460ee8cb38d4fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/0e/130ebbfce184e74e638ea48458bb89c7/pa/DV89996_45f7463e0740bef1b4460ee8cb38d4fd.jpg already downloaded
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F0e%252F130ebbfce184e74e638ea48458bb89c7%252Fpa%252FDV89996_235689c508a6cf6baf5e047a62fd69b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/0e/130ebbfce184e74e638ea48458bb89c7/pa/DV89996_235689c508a6cf6baf5e047a62fd69b4.jpg already downloaded
2026-03-28 12:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a25493cd-b05c-5c17-bb7e-d0612eb87950, identifier: DV89996
2026-03-28 12:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3eb790>
2026-03-28 12:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e101787d-807d-5642-b1ac-827c628c6848/e101787d-807d-5642-b1ac-827c628c6848_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166f747e54bfdda8ced80164d01af69%252Fpa%252FVY27693_c93e57157d4a3821f74b53783294774f.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_c93e57157d4a3821f74b53783294774f.jpg saved to cache
2026-03-28 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e101787d-807d-5642-b1ac-827c628c6848
2026-03-28 12:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc585850>
2026-03-28 12:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f005e36-16d3-5521-82dc-2e1786c34f8b/0f005e36-16d3-5521-82dc-2e1786c34f8b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F9f%252Fbf9f3989c9a9f3e1d1be9d8f6ba100e0%252Fpa%252FET22397_ecfa660b52ca810aa5cf70d7c1bfe623.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_ecfa660b52ca810aa5cf70d7c1bfe623.jpg saved to cache
2026-03-28 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f005e36-16d3-5521-82dc-2e1786c34f8b
2026-03-28 12:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3e6690>
2026-03-28 12:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0941f7ce-8192-5540-beaf-6361d966fc21/0941f7ce-8192-5540-beaf-6361d966fc21_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F92%252F73928da73745969342cf8ac13fbe47d4%252Fpa%252FET05908_8af6e3ad1ce8414feb9934ffd9e1f1e3.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/92/73928da73745969342cf8ac13fbe47d4/pa/ET05908_8af6e3ad1ce8414feb9934ffd9e1f1e3.jpg saved to cache
2026-03-28 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0941f7ce-8192-5540-beaf-6361d966fc21
2026-03-28 12:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/92/73928da73745969342cf8ac13fbe47d4/pa/ET05908_244b3d373ef1eaeb9e546aa99681cafc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a25493cd-b05c-5c17-bb7e-d0612eb87950 with identifier: DV89996
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-28 12:05:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a25493cd-b05c-5c17-bb7e-d0612eb87950 with identifier: DV89996
2026-03-28 12:05:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a25493cd-b05c-5c17-bb7e-d0612eb87950 with identifier: DV89996 to the API
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DV89996>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:55:31Z',
 'fuel_type': 'petrol',
 'id': 'a25493cd-b05c-5c17-bb7e-d0612eb87950',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV89996',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 74129,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img13/0e/130ebbfce184e74e638ea48458bb89c7/pa/DV89996_9c1004a567a76a154d12e94be65adede.jpg',
                'https://img-pa.auto1.com/img13/0e/130ebbfce184e74e638ea48458bb89c7/pa/DV89996_66489152e705fd618f411c92f498018f.jpg',
                'https://img-pa.auto1.com/img13/0e/130ebbfce184e74e638ea48458bb89c7/pa/DV89996_b2775f5f4132a851cfff777cc015254f.jpg',
                'https://img-pa.auto1.com/img13/0e/130ebbfce184e74e638ea48458bb89c7/pa/DV89996_e029bba55772059a2ad5a26b02fd7bcb.jpg',
                'https://img-pa.auto1.com/img13/0e/130ebbfce184e74e638ea48458bb89c7/pa/DV89996_debfb8404e5667379f5b84615d23f535.jpg',
                'https://img-pa.auto1.com/img13/0e/130ebbfce184e74e638ea48458bb89c7/pa/DV89996_90331da6737d7ac203526adf58bbb918.jpg',
                'https://img-pa.auto1.com/img13/0e/130ebbfce184e74e638ea48458bb89c7/pa/DV89996_31a568b5ee06c664da17739bccc184b9.jpg',
                'https://img-pa.auto1.com/img13/0e/130ebbfce184e74e638ea48458bb89c7/pa/DV89996_79cd9bd9cbac58e8de2c32089a56acb9.jpg',
                'https://img-pa.auto1.com/img13/0e/130ebbfce184e74e638ea48458bb89c7/pa/DV89996_45f7463e0740bef1b4460ee8cb38d4fd.jpg',
                'https://img-pa.auto1.com/img13/0e/130ebbfce184e74e638ea48458bb89c7/pa/DV89996_235689c508a6cf6baf5e047a62fd69b4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a25493cd-b05c-5c17-bb7e-d0612eb87950/a25493cd-b05c-5c17-bb7e-d0612eb87950_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/0e/130ebbfce184e74e638ea48458bb89c7/pa/DV89996_9c1004a567a76a154d12e94be65adede.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a25493cd-b05c-5c17-bb7e-d0612eb87950/a25493cd-b05c-5c17-bb7e-d0612eb87950_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/0e/130ebbfce184e74e638ea48458bb89c7/pa/DV89996_66489152e705fd618f411c92f498018f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a25493cd-b05c-5c17-bb7e-d0612eb87950/a25493cd-b05c-5c17-bb7e-d0612eb87950_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/0e/130ebbfce184e74e638ea48458bb89c7/pa/DV89996_b2775f5f4132a851cfff777cc015254f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a25493cd-b05c-5c17-bb7e-d0612eb87950/a25493cd-b05c-5c17-bb7e-d0612eb87950_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59464,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/0e/130ebbfce184e74e638ea48458bb89c7/pa/DV89996_e029bba55772059a2ad5a26b02fd7bcb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a25493cd-b05c-5c17-bb7e-d0612eb87950/a25493cd-b05c-5c17-bb7e-d0612eb87950_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2553225,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/0e/130ebbfce184e74e638ea48458bb89c7/pa/DV89996_debfb8404e5667379f5b84615d23f535.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a25493cd-b05c-5c17-bb7e-d0612eb87950/a25493cd-b05c-5c17-bb7e-d0612eb87950_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/0e/130ebbfce184e74e638ea48458bb89c7/pa/DV89996_90331da6737d7ac203526adf58bbb918.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a25493cd-b05c-5c17-bb7e-d0612eb87950/a25493cd-b05c-5c17-bb7e-d0612eb87950_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64224,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/0e/130ebbfce184e74e638ea48458bb89c7/pa/DV89996_31a568b5ee06c664da17739bccc184b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a25493cd-b05c-5c17-bb7e-d0612eb87950/a25493cd-b05c-5c17-bb7e-d0612eb87950_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/0e/130ebbfce184e74e638ea48458bb89c7/pa/DV89996_79cd9bd9cbac58e8de2c32089a56acb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a25493cd-b05c-5c17-bb7e-d0612eb87950/a25493cd-b05c-5c17-bb7e-d0612eb87950_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64336,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/0e/130ebbfce184e74e638ea48458bb89c7/pa/DV89996_45f7463e0740bef1b4460ee8cb38d4fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a25493cd-b05c-5c17-bb7e-d0612eb87950/a25493cd-b05c-5c17-bb7e-d0612eb87950_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/0e/130ebbfce184e74e638ea48458bb89c7/pa/DV89996_235689c508a6cf6baf5e047a62fd69b4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-09-27',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2015}
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV89996%27 HTTP/1.1" 200 None
2026-03-28 12:05:39 [auto1.it] INFO: Saving data for DV89996: {'created_time': 1774699539.911877, 'last_price_update_time': 1774699539.911889, 'auction_closing_time': 1774886131.0}
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DV89996') HTTP/1.1" 204 0
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff9%252F35f9837c493f6daf1a433b99a731a16d%252Fpa%252FSB06120_1d4dd6cf097152ced5f16220327ca726.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_1d4dd6cf097152ced5f16220327ca726.jpg not downloaded yet
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F8f%252F4f8f3f6e53cc88a9863b8359d559eb36%252Fpa%252FGC21308_cd23387eb493df6ddc23452b74f26761.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_cd23387eb493df6ddc23452b74f26761.jpg not downloaded yet
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F00%252F1900fee19e0209ec751035b1964e0511%252Fpa%252FRT68139_784480eae4f448f3394d92c30c086edd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_784480eae4f448f3394d92c30c086edd.jpg not downloaded yet
2026-03-28 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F96%252F0f9646a6cfd213c4cee53277aa5b9b3d%252Fpa%252FWN69179_daf71623c49069be5b49d58db344b1a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/96/0f9646a6cfd213c4cee53277aa5b9b3d/pa/WN69179_daf71623c49069be5b49d58db344b1a3.jpg not downloaded yet
2026-03-28 12:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3aa950>
2026-03-28 12:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0941f7ce-8192-5540-beaf-6361d966fc21/0941f7ce-8192-5540-beaf-6361d966fc21_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F92%252F73928da73745969342cf8ac13fbe47d4%252Fpa%252FET05908_6f1c72f2025e24fd12d39d0b6e0ce5ad.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/92/73928da73745969342cf8ac13fbe47d4/pa/ET05908_6f1c72f2025e24fd12d39d0b6e0ce5ad.jpg saved to cache
2026-03-28 12:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0941f7ce-8192-5540-beaf-6361d966fc21
2026-03-28 12:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc607810>
2026-03-28 12:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f005e36-16d3-5521-82dc-2e1786c34f8b/0f005e36-16d3-5521-82dc-2e1786c34f8b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F9f%252Fbf9f3989c9a9f3e1d1be9d8f6ba100e0%252Fpa%252FET22397_2615b885b84ffbd59c52d3438f400920.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_2615b885b84ffbd59c52d3438f400920.jpg saved to cache
2026-03-28 12:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0f005e36-16d3-5521-82dc-2e1786c34f8b
2026-03-28 12:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_8be329bdba306f4c755279a6cbd6c797.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KM48378> (referer: https://www.auto1.com/v1/car-details-view/KM48378/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff9%252F35f9837c493f6daf1a433b99a731a16d%252Fpa%252FSB06120_f0e75da8b32f13394a1cf6fb367204c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_f0e75da8b32f13394a1cf6fb367204c6.jpg not downloaded yet
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F8f%252F4f8f3f6e53cc88a9863b8359d559eb36%252Fpa%252FGC21308_a464400fd3d1ed8a98824849c73a41b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_a464400fd3d1ed8a98824849c73a41b1.jpg not downloaded yet
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F00%252F1900fee19e0209ec751035b1964e0511%252Fpa%252FRT68139_959a0921adc705a9448cc3b7d4d356f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_959a0921adc705a9448cc3b7d4d356f8.jpg not downloaded yet
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F96%252F0f9646a6cfd213c4cee53277aa5b9b3d%252Fpa%252FWN69179_bbaf443aeda8049cd8d859ab589d8513.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/96/0f9646a6cfd213c4cee53277aa5b9b3d/pa/WN69179_bbaf443aeda8049cd8d859ab589d8513.jpg not downloaded yet
2026-03-28 12:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GU07540> (referer: https://www.auto1.com/v1/car-details-view/GU07540/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd14b550>
2026-03-28 12:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0941f7ce-8192-5540-beaf-6361d966fc21/0941f7ce-8192-5540-beaf-6361d966fc21_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F92%252F73928da73745969342cf8ac13fbe47d4%252Fpa%252FET05908_244b3d373ef1eaeb9e546aa99681cafc.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/92/73928da73745969342cf8ac13fbe47d4/pa/ET05908_244b3d373ef1eaeb9e546aa99681cafc.jpg saved to cache
2026-03-28 12:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0941f7ce-8192-5540-beaf-6361d966fc21
2026-03-28 12:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_80c67501bf8191431b8ced6d24522e51.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff9%252F35f9837c493f6daf1a433b99a731a16d%252Fpa%252FSB06120_96d4d06c6e2c2084806515db219c22a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_96d4d06c6e2c2084806515db219c22a1.jpg not downloaded yet
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F8f%252F4f8f3f6e53cc88a9863b8359d559eb36%252Fpa%252FGC21308_4f524dd7936f291724e2b5ebadb7ad81.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_4f524dd7936f291724e2b5ebadb7ad81.jpg not downloaded yet
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F00%252F1900fee19e0209ec751035b1964e0511%252Fpa%252FRT68139_0f0d31b047dabe25c0c9bc7c2424cf1f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_0f0d31b047dabe25c0c9bc7c2424cf1f.jpg not downloaded yet
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F96%252F0f9646a6cfd213c4cee53277aa5b9b3d%252Fpa%252FWN69179_e0b4c81ef53bb6c49f3b2f1746154cec.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/96/0f9646a6cfd213c4cee53277aa5b9b3d/pa/WN69179_e0b4c81ef53bb6c49f3b2f1746154cec.jpg not downloaded yet
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F8f%252F4f8f3f6e53cc88a9863b8359d559eb36%252Fpa%252FGC21308_276488da870f8d6ea37f855dba9e700d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_276488da870f8d6ea37f855dba9e700d.jpg not downloaded yet
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F00%252F1900fee19e0209ec751035b1964e0511%252Fpa%252FRT68139_b117b5f334370669fdc4d59e302059b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_b117b5f334370669fdc4d59e302059b1.jpg not downloaded yet
2026-03-28 12:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd031b50>
2026-03-28 12:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e101787d-807d-5642-b1ac-827c628c6848/e101787d-807d-5642-b1ac-827c628c6848_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166f747e54bfdda8ced80164d01af69%252Fpa%252FVY27693_8be329bdba306f4c755279a6cbd6c797.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_8be329bdba306f4c755279a6cbd6c797.jpg saved to cache
2026-03-28 12:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e101787d-807d-5642-b1ac-827c628c6848
2026-03-28 12:05:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff83685c-2005-5f9d-ad58-21daba76a93b with identifier: KM48378
2026-03-28 12:05:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff83685c-2005-5f9d-ad58-21daba76a93b with scrape type 1
2026-03-28 12:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ff83685c-2005-5f9d-ad58-21daba76a93b
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F59%252Fbc592050454390ec8e01987eeb1d3e29%252Fpa%252FKM48378_afdc5037ece90c198fe095b44af9395b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/59/bc592050454390ec8e01987eeb1d3e29/pa/KM48378_afdc5037ece90c198fe095b44af9395b.jpg already downloaded
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F59%252Fbc592050454390ec8e01987eeb1d3e29%252Fpa%252FKM48378_14a6aef6ce083ae9b45d81c8420362a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/59/bc592050454390ec8e01987eeb1d3e29/pa/KM48378_14a6aef6ce083ae9b45d81c8420362a2.jpg already downloaded
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F59%252Fbc592050454390ec8e01987eeb1d3e29%252Fpa%252FKM48378_703f9155df1943219fa20a515a910103.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/59/bc592050454390ec8e01987eeb1d3e29/pa/KM48378_703f9155df1943219fa20a515a910103.jpg already downloaded
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F59%252Fbc592050454390ec8e01987eeb1d3e29%252Fpa%252FKM48378_4ee64d92c77f82e71ea416ceb7f732c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/59/bc592050454390ec8e01987eeb1d3e29/pa/KM48378_4ee64d92c77f82e71ea416ceb7f732c2.jpg already downloaded
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F59%252Fbc592050454390ec8e01987eeb1d3e29%252Fpa%252FKM48378_db2a2ce90994e67bbbb5926a0090a5af.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/59/bc592050454390ec8e01987eeb1d3e29/pa/KM48378_db2a2ce90994e67bbbb5926a0090a5af.jpg already downloaded
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F59%252Fbc592050454390ec8e01987eeb1d3e29%252Fpa%252FKM48378_8f53fa28f7bbc642a1f06ce4d67c63ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/59/bc592050454390ec8e01987eeb1d3e29/pa/KM48378_8f53fa28f7bbc642a1f06ce4d67c63ba.jpg already downloaded
2026-03-28 12:05:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ff83685c-2005-5f9d-ad58-21daba76a93b, identifier: KM48378
2026-03-28 12:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_4a4d37b82a0d7d2eaffab8489c435f91.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ff83685c-2005-5f9d-ad58-21daba76a93b with identifier: KM48378
2026-03-28 12:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ff83685c-2005-5f9d-ad58-21daba76a93b with identifier: KM48378
2026-03-28 12:05:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ff83685c-2005-5f9d-ad58-21daba76a93b with identifier: KM48378 to the API
2026-03-28 12:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KM48378>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '1.9L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:53:50Z',
 'fuel_type': 'diesel',
 'id': 'ff83685c-2005-5f9d-ad58-21daba76a93b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM48378',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 230746,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgbc/59/bc592050454390ec8e01987eeb1d3e29/pa/KM48378_afdc5037ece90c198fe095b44af9395b.jpg',
                'https://img-pa.auto1.com/imgbc/59/bc592050454390ec8e01987eeb1d3e29/pa/KM48378_14a6aef6ce083ae9b45d81c8420362a2.jpg',
                'https://img-pa.auto1.com/imgbc/59/bc592050454390ec8e01987eeb1d3e29/pa/KM48378_703f9155df1943219fa20a515a910103.jpg',
                'https://img-pa.auto1.com/imgbc/59/bc592050454390ec8e01987eeb1d3e29/pa/KM48378_4ee64d92c77f82e71ea416ceb7f732c2.jpg',
                'https://img-pa.auto1.com/imgbc/59/bc592050454390ec8e01987eeb1d3e29/pa/KM48378_db2a2ce90994e67bbbb5926a0090a5af.jpg',
                'https://img-pa.auto1.com/imgbc/59/bc592050454390ec8e01987eeb1d3e29/pa/KM48378_8f53fa28f7bbc642a1f06ce4d67c63ba.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff83685c-2005-5f9d-ad58-21daba76a93b/ff83685c-2005-5f9d-ad58-21daba76a93b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/59/bc592050454390ec8e01987eeb1d3e29/pa/KM48378_afdc5037ece90c198fe095b44af9395b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff83685c-2005-5f9d-ad58-21daba76a93b/ff83685c-2005-5f9d-ad58-21daba76a93b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/59/bc592050454390ec8e01987eeb1d3e29/pa/KM48378_14a6aef6ce083ae9b45d81c8420362a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff83685c-2005-5f9d-ad58-21daba76a93b/ff83685c-2005-5f9d-ad58-21daba76a93b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/59/bc592050454390ec8e01987eeb1d3e29/pa/KM48378_703f9155df1943219fa20a515a910103.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff83685c-2005-5f9d-ad58-21daba76a93b/ff83685c-2005-5f9d-ad58-21daba76a93b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/59/bc592050454390ec8e01987eeb1d3e29/pa/KM48378_4ee64d92c77f82e71ea416ceb7f732c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff83685c-2005-5f9d-ad58-21daba76a93b/ff83685c-2005-5f9d-ad58-21daba76a93b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/59/bc592050454390ec8e01987eeb1d3e29/pa/KM48378_db2a2ce90994e67bbbb5926a0090a5af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff83685c-2005-5f9d-ad58-21daba76a93b/ff83685c-2005-5f9d-ad58-21daba76a93b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/59/bc592050454390ec8e01987eeb1d3e29/pa/KM48378_8f53fa28f7bbc642a1f06ce4d67c63ba.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2001-03-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.9 TDI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2001}
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM48378%27 HTTP/1.1" 200 None
2026-03-28 12:05:41 [auto1.it] INFO: Saving data for KM48378: {'created_time': 1774699541.317793, 'last_price_update_time': 1774699541.317803, 'auction_closing_time': 1774886030.0}
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KM48378') HTTP/1.1" 204 0
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F8f%252F4f8f3f6e53cc88a9863b8359d559eb36%252Fpa%252FGC21308_84a87d064260fec20b869ba4d9794ba4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_84a87d064260fec20b869ba4d9794ba4.jpg not downloaded yet
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F00%252F1900fee19e0209ec751035b1964e0511%252Fpa%252FRT68139_fd7aeaec7c35da2c264bb179aa005311.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_fd7aeaec7c35da2c264bb179aa005311.jpg not downloaded yet
2026-03-28 12:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 088d57a3-5af2-5c36-a990-35ce8808940e with identifier: GU07540
2026-03-28 12:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 088d57a3-5af2-5c36-a990-35ce8808940e with scrape type 1
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 088d57a3-5af2-5c36-a990-35ce8808940e
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fcf%252F5acfcf4731ae78155bd2055c60c50204%252Fpa%252FGU07540_a954de472c8e23e353f445e63963c9cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/cf/5acfcf4731ae78155bd2055c60c50204/pa/GU07540_a954de472c8e23e353f445e63963c9cb.jpg not downloaded yet
2026-03-28 12:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_a10647a8f3a1f9f7b37909754dbe4c35.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_8773dda2c8fb99fb00617af524941371.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F8f%252F4f8f3f6e53cc88a9863b8359d559eb36%252Fpa%252FGC21308_2767a6c251bc510038db0f363c28c3a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_2767a6c251bc510038db0f363c28c3a6.jpg not downloaded yet
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F00%252F1900fee19e0209ec751035b1964e0511%252Fpa%252FRT68139_f4c94bc529d34b9d2e53ca5374436dae.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_f4c94bc529d34b9d2e53ca5374436dae.jpg not downloaded yet
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fcf%252F5acfcf4731ae78155bd2055c60c50204%252Fpa%252FGU07540_cc42a330fed60da52cf41de31fb89e1c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/cf/5acfcf4731ae78155bd2055c60c50204/pa/GU07540_cc42a330fed60da52cf41de31fb89e1c.jpg not downloaded yet
2026-03-28 12:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ND60676> (referer: https://www.auto1.com/v1/car-details-view/ND60676/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DF10030> (referer: https://www.auto1.com/v1/car-details-view/DF10030/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc377bd0>
2026-03-28 12:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e101787d-807d-5642-b1ac-827c628c6848/e101787d-807d-5642-b1ac-827c628c6848_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166f747e54bfdda8ced80164d01af69%252Fpa%252FVY27693_80c67501bf8191431b8ced6d24522e51.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_80c67501bf8191431b8ced6d24522e51.jpg saved to cache
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e101787d-807d-5642-b1ac-827c628c6848
2026-03-28 12:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bf6b9f50>
2026-03-28 12:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dcf2a9c-dbdc-5011-830a-9f40907f3173/5dcf2a9c-dbdc-5011-830a-9f40907f3173_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff9%252F35f9837c493f6daf1a433b99a731a16d%252Fpa%252FSB06120_4a4d37b82a0d7d2eaffab8489c435f91.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_4a4d37b82a0d7d2eaffab8489c435f91.jpg saved to cache
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5dcf2a9c-dbdc-5011-830a-9f40907f3173
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F8f%252F4f8f3f6e53cc88a9863b8359d559eb36%252Fpa%252FGC21308_3844650179c50636d445d1b010541e30.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_3844650179c50636d445d1b010541e30.jpg not downloaded yet
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F00%252F1900fee19e0209ec751035b1964e0511%252Fpa%252FRT68139_07d906e62936f0658de18157caf13dcc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_07d906e62936f0658de18157caf13dcc.jpg not downloaded yet
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fcf%252F5acfcf4731ae78155bd2055c60c50204%252Fpa%252FGU07540_f32ba41ad3a976c03ab748d6663f91b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/cf/5acfcf4731ae78155bd2055c60c50204/pa/GU07540_f32ba41ad3a976c03ab748d6663f91b5.jpg not downloaded yet
2026-03-28 12:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_9eb800c8c0ff9e13e7a81f2d1e83925f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/96/0f9646a6cfd213c4cee53277aa5b9b3d/pa/WN69179_3d063739835f34fcaecddb48888c8cb6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F8f%252F4f8f3f6e53cc88a9863b8359d559eb36%252Fpa%252FGC21308_ce859725ff0100e422913f9f2e7832e6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_ce859725ff0100e422913f9f2e7832e6.jpg not downloaded yet
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F00%252F1900fee19e0209ec751035b1964e0511%252Fpa%252FRT68139_cb842f0c3a42f688cff135d282b1e389.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_cb842f0c3a42f688cff135d282b1e389.jpg not downloaded yet
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fcf%252F5acfcf4731ae78155bd2055c60c50204%252Fpa%252FGU07540_b4e201f8b06aaf131d23422882fe9ce3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/cf/5acfcf4731ae78155bd2055c60c50204/pa/GU07540_b4e201f8b06aaf131d23422882fe9ce3.jpg not downloaded yet
2026-03-28 12:05:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc387910>
2026-03-28 12:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bf022d-7d60-5a1a-80ee-3a1d403d3872/91bf022d-7d60-5a1a-80ee-3a1d403d3872_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fb1%252F86b13e7fe20b0ac0511511fa2d3aaa00%252Fpa%252FAY76833_a10647a8f3a1f9f7b37909754dbe4c35.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_a10647a8f3a1f9f7b37909754dbe4c35.jpg saved to cache
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 91bf022d-7d60-5a1a-80ee-3a1d403d3872
2026-03-28 12:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc383d10>
2026-03-28 12:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dcf2a9c-dbdc-5011-830a-9f40907f3173/5dcf2a9c-dbdc-5011-830a-9f40907f3173_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff9%252F35f9837c493f6daf1a433b99a731a16d%252Fpa%252FSB06120_8773dda2c8fb99fb00617af524941371.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_8773dda2c8fb99fb00617af524941371.jpg saved to cache
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5dcf2a9c-dbdc-5011-830a-9f40907f3173
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fcf%252F5acfcf4731ae78155bd2055c60c50204%252Fpa%252FGU07540_7d1c0fe6ef84697a828c4bdecab98a6c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/cf/5acfcf4731ae78155bd2055c60c50204/pa/GU07540_7d1c0fe6ef84697a828c4bdecab98a6c.jpg not downloaded yet
2026-03-28 12:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5aaec82-c481-5495-bb93-b26eee04f68f with identifier: ND60676
2026-03-28 12:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5aaec82-c481-5495-bb93-b26eee04f68f with scrape type 1
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e5aaec82-c481-5495-bb93-b26eee04f68f
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F31%252F9531363dcd45a6ba851beb6fa0751092%252Fpa%252FND60676_408bfc0db5ffe3db5378cd2bc243b2be.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_408bfc0db5ffe3db5378cd2bc243b2be.jpg not downloaded yet
2026-03-28 12:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f3c9d7a-9924-5552-9d4f-def1cec9be0a with identifier: DF10030
2026-03-28 12:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f3c9d7a-9924-5552-9d4f-def1cec9be0a with scrape type 1
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2f3c9d7a-9924-5552-9d4f-def1cec9be0a
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F33%252Fc033943d0c928a72af6885f36c6324f5%252Fpa%252FDF10030_efc8eb7137f1f953ca1cd38d766b0d5c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_efc8eb7137f1f953ca1cd38d766b0d5c.jpg not downloaded yet
2026-03-28 12:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_da172acf9b758d08fcb9831f114ad9e2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F31%252F9531363dcd45a6ba851beb6fa0751092%252Fpa%252FND60676_6d3369feb6910ef07af8ee73b094e7a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_6d3369feb6910ef07af8ee73b094e7a6.jpg not downloaded yet
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F33%252Fc033943d0c928a72af6885f36c6324f5%252Fpa%252FDF10030_d81757ffeefbb8300767506f4d9dfffe.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_d81757ffeefbb8300767506f4d9dfffe.jpg not downloaded yet
2026-03-28 12:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_784480eae4f448f3394d92c30c086edd.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc4f6f10>
2026-03-28 12:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e101787d-807d-5642-b1ac-827c628c6848/e101787d-807d-5642-b1ac-827c628c6848_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166f747e54bfdda8ced80164d01af69%252Fpa%252FVY27693_9eb800c8c0ff9e13e7a81f2d1e83925f.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_9eb800c8c0ff9e13e7a81f2d1e83925f.jpg saved to cache
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e101787d-807d-5642-b1ac-827c628c6848
2026-03-28 12:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3e2790>
2026-03-28 12:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4fa818f-fb69-545b-978b-23bcaecd0161/a4fa818f-fb69-545b-978b-23bcaecd0161_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F96%252F0f9646a6cfd213c4cee53277aa5b9b3d%252Fpa%252FWN69179_3d063739835f34fcaecddb48888c8cb6.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/96/0f9646a6cfd213c4cee53277aa5b9b3d/pa/WN69179_3d063739835f34fcaecddb48888c8cb6.jpg saved to cache
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a4fa818f-fb69-545b-978b-23bcaecd0161
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F31%252F9531363dcd45a6ba851beb6fa0751092%252Fpa%252FND60676_cff841913ade50b96a8b4f633aa469c1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_cff841913ade50b96a8b4f633aa469c1.jpg not downloaded yet
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F33%252Fc033943d0c928a72af6885f36c6324f5%252Fpa%252FDF10030_8c831ecf6fafe9521d80aa2477b8d14b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_8c831ecf6fafe9521d80aa2477b8d14b.jpg not downloaded yet
2026-03-28 12:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/96/0f9646a6cfd213c4cee53277aa5b9b3d/pa/WN69179_daf71623c49069be5b49d58db344b1a3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F31%252F9531363dcd45a6ba851beb6fa0751092%252Fpa%252FND60676_4be7b7d56628c833fddd92a75f8cabf5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_4be7b7d56628c833fddd92a75f8cabf5.jpg not downloaded yet
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F33%252Fc033943d0c928a72af6885f36c6324f5%252Fpa%252FDF10030_176216792e42d3a79e2c6dee5f070147.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_176216792e42d3a79e2c6dee5f070147.jpg not downloaded yet
2026-03-28 12:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_b117b5f334370669fdc4d59e302059b1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/96/0f9646a6cfd213c4cee53277aa5b9b3d/pa/WN69179_bbaf443aeda8049cd8d859ab589d8513.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F31%252F9531363dcd45a6ba851beb6fa0751092%252Fpa%252FND60676_39537e6fd76b200b2ae266bda0ea4e58.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_39537e6fd76b200b2ae266bda0ea4e58.jpg not downloaded yet
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F33%252Fc033943d0c928a72af6885f36c6324f5%252Fpa%252FDF10030_30b2e735054146cc49d66287bdc51155.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_30b2e735054146cc49d66287bdc51155.jpg not downloaded yet
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf677d0>
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd/65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F00%252F1900fee19e0209ec751035b1964e0511%252Fpa%252FRT68139_da172acf9b758d08fcb9831f114ad9e2.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_da172acf9b758d08fcb9831f114ad9e2.jpg saved to cache
2026-03-28 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5402d0>
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd/65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F00%252F1900fee19e0209ec751035b1964e0511%252Fpa%252FRT68139_784480eae4f448f3394d92c30c086edd.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_784480eae4f448f3394d92c30c086edd.jpg saved to cache
2026-03-28 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F31%252F9531363dcd45a6ba851beb6fa0751092%252Fpa%252FND60676_8d9f473a22ec9ecab371cd9b2140f1f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_8d9f473a22ec9ecab371cd9b2140f1f1.jpg not downloaded yet
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F33%252Fc033943d0c928a72af6885f36c6324f5%252Fpa%252FDF10030_9aa3a0d317716312dd6766728e372a01.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_9aa3a0d317716312dd6766728e372a01.jpg not downloaded yet
2026-03-28 12:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_2f12aac290764a932c408217a2d8ad00.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F31%252F9531363dcd45a6ba851beb6fa0751092%252Fpa%252FND60676_ad89a6a973607603d82191bd2d855e02.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_ad89a6a973607603d82191bd2d855e02.jpg not downloaded yet
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F33%252Fc033943d0c928a72af6885f36c6324f5%252Fpa%252FDF10030_89c68a5f8f498ac45687d13e97be1af8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_89c68a5f8f498ac45687d13e97be1af8.jpg not downloaded yet
2026-03-28 12:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/96/0f9646a6cfd213c4cee53277aa5b9b3d/pa/WN69179_e0b4c81ef53bb6c49f3b2f1746154cec.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf8a7d0>
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4fa818f-fb69-545b-978b-23bcaecd0161/a4fa818f-fb69-545b-978b-23bcaecd0161_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F96%252F0f9646a6cfd213c4cee53277aa5b9b3d%252Fpa%252FWN69179_daf71623c49069be5b49d58db344b1a3.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/96/0f9646a6cfd213c4cee53277aa5b9b3d/pa/WN69179_daf71623c49069be5b49d58db344b1a3.jpg saved to cache
2026-03-28 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a4fa818f-fb69-545b-978b-23bcaecd0161
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc595210>
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd/65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F00%252F1900fee19e0209ec751035b1964e0511%252Fpa%252FRT68139_b117b5f334370669fdc4d59e302059b1.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_b117b5f334370669fdc4d59e302059b1.jpg saved to cache
2026-03-28 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3ca310>
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4fa818f-fb69-545b-978b-23bcaecd0161/a4fa818f-fb69-545b-978b-23bcaecd0161_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F96%252F0f9646a6cfd213c4cee53277aa5b9b3d%252Fpa%252FWN69179_bbaf443aeda8049cd8d859ab589d8513.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/96/0f9646a6cfd213c4cee53277aa5b9b3d/pa/WN69179_bbaf443aeda8049cd8d859ab589d8513.jpg saved to cache
2026-03-28 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a4fa818f-fb69-545b-978b-23bcaecd0161
2026-03-28 12:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/cf/5acfcf4731ae78155bd2055c60c50204/pa/GU07540_a954de472c8e23e353f445e63963c9cb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F31%252F9531363dcd45a6ba851beb6fa0751092%252Fpa%252FND60676_66b8ac40d01c213d3fd2810ba22aeafa.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_66b8ac40d01c213d3fd2810ba22aeafa.jpg not downloaded yet
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F33%252Fc033943d0c928a72af6885f36c6324f5%252Fpa%252FDF10030_57dab2ce5a899cde238fee84ff5e31c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_57dab2ce5a899cde238fee84ff5e31c6.jpg not downloaded yet
2026-03-28 12:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_276488da870f8d6ea37f855dba9e700d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_3f5079f8bb89adf752938f8f71623f43.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F31%252F9531363dcd45a6ba851beb6fa0751092%252Fpa%252FND60676_5cedaf22d1fe3e750ca01cc8100271d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_5cedaf22d1fe3e750ca01cc8100271d2.jpg not downloaded yet
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F33%252Fc033943d0c928a72af6885f36c6324f5%252Fpa%252FDF10030_4bdc1b8a5d90601cd1b14f336f70f5d0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_4bdc1b8a5d90601cd1b14f336f70f5d0.jpg not downloaded yet
2026-03-28 12:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_1cd92b84b0bf579af340ab40ab8e171b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/cf/5acfcf4731ae78155bd2055c60c50204/pa/GU07540_f32ba41ad3a976c03ab748d6663f91b5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F31%252F9531363dcd45a6ba851beb6fa0751092%252Fpa%252FND60676_fb7fc651367fba24ce699f494c66beef.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_fb7fc651367fba24ce699f494c66beef.jpg not downloaded yet
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F33%252Fc033943d0c928a72af6885f36c6324f5%252Fpa%252FDF10030_317403a24f4725a8c7d81c6aaf914b85.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_317403a24f4725a8c7d81c6aaf914b85.jpg not downloaded yet
2026-03-28 12:05:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc564550>
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f005e36-16d3-5521-82dc-2e1786c34f8b/0f005e36-16d3-5521-82dc-2e1786c34f8b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F9f%252Fbf9f3989c9a9f3e1d1be9d8f6ba100e0%252Fpa%252FET22397_2f12aac290764a932c408217a2d8ad00.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_2f12aac290764a932c408217a2d8ad00.jpg saved to cache
2026-03-28 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0f005e36-16d3-5521-82dc-2e1786c34f8b
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf8b710>
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4fa818f-fb69-545b-978b-23bcaecd0161/a4fa818f-fb69-545b-978b-23bcaecd0161_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F96%252F0f9646a6cfd213c4cee53277aa5b9b3d%252Fpa%252FWN69179_e0b4c81ef53bb6c49f3b2f1746154cec.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/96/0f9646a6cfd213c4cee53277aa5b9b3d/pa/WN69179_e0b4c81ef53bb6c49f3b2f1746154cec.jpg saved to cache
2026-03-28 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a4fa818f-fb69-545b-978b-23bcaecd0161
2026-03-28 12:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/cf/5acfcf4731ae78155bd2055c60c50204/pa/GU07540_b4e201f8b06aaf131d23422882fe9ce3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_fd7aeaec7c35da2c264bb179aa005311.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_07d906e62936f0658de18157caf13dcc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3d61d0>
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_088d57a3-5af2-5c36-a990-35ce8808940e/088d57a3-5af2-5c36-a990-35ce8808940e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fcf%252F5acfcf4731ae78155bd2055c60c50204%252Fpa%252FGU07540_a954de472c8e23e353f445e63963c9cb.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/cf/5acfcf4731ae78155bd2055c60c50204/pa/GU07540_a954de472c8e23e353f445e63963c9cb.jpg saved to cache
2026-03-28 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 088d57a3-5af2-5c36-a990-35ce8808940e
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc608490>
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97978bda-0d93-5484-92c8-f1ce53e9d5c2/97978bda-0d93-5484-92c8-f1ce53e9d5c2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F8f%252F4f8f3f6e53cc88a9863b8359d559eb36%252Fpa%252FGC21308_276488da870f8d6ea37f855dba9e700d.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_276488da870f8d6ea37f855dba9e700d.jpg saved to cache
2026-03-28 12:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 97978bda-0d93-5484-92c8-f1ce53e9d5c2
2026-03-28 12:05:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfbf150>
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e101787d-807d-5642-b1ac-827c628c6848/e101787d-807d-5642-b1ac-827c628c6848_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166f747e54bfdda8ced80164d01af69%252Fpa%252FVY27693_3f5079f8bb89adf752938f8f71623f43.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_3f5079f8bb89adf752938f8f71623f43.jpg saved to cache
2026-03-28 12:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e101787d-807d-5642-b1ac-827c628c6848
2026-03-28 12:05:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf14110>
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dcf2a9c-dbdc-5011-830a-9f40907f3173/5dcf2a9c-dbdc-5011-830a-9f40907f3173_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff9%252F35f9837c493f6daf1a433b99a731a16d%252Fpa%252FSB06120_1cd92b84b0bf579af340ab40ab8e171b.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_1cd92b84b0bf579af340ab40ab8e171b.jpg saved to cache
2026-03-28 12:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5dcf2a9c-dbdc-5011-830a-9f40907f3173
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd0fd950>
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_088d57a3-5af2-5c36-a990-35ce8808940e/088d57a3-5af2-5c36-a990-35ce8808940e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fcf%252F5acfcf4731ae78155bd2055c60c50204%252Fpa%252FGU07540_f32ba41ad3a976c03ab748d6663f91b5.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/cf/5acfcf4731ae78155bd2055c60c50204/pa/GU07540_f32ba41ad3a976c03ab748d6663f91b5.jpg saved to cache
2026-03-28 12:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 088d57a3-5af2-5c36-a990-35ce8808940e
2026-03-28 12:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_a4c0c27d827afe18c5890114066de48a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_02ba9821f6c50442752007e7ae9219bd.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_4be7b7d56628c833fddd92a75f8cabf5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_9aa3a0d317716312dd6766728e372a01.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_8d9f473a22ec9ecab371cd9b2140f1f1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc572a50>
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_088d57a3-5af2-5c36-a990-35ce8808940e/088d57a3-5af2-5c36-a990-35ce8808940e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fcf%252F5acfcf4731ae78155bd2055c60c50204%252Fpa%252FGU07540_b4e201f8b06aaf131d23422882fe9ce3.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/cf/5acfcf4731ae78155bd2055c60c50204/pa/GU07540_b4e201f8b06aaf131d23422882fe9ce3.jpg saved to cache
2026-03-28 12:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 088d57a3-5af2-5c36-a990-35ce8808940e
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3fd110>
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd/65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F00%252F1900fee19e0209ec751035b1964e0511%252Fpa%252FRT68139_fd7aeaec7c35da2c264bb179aa005311.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_fd7aeaec7c35da2c264bb179aa005311.jpg saved to cache
2026-03-28 12:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc55ae90>
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd/65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F00%252F1900fee19e0209ec751035b1964e0511%252Fpa%252FRT68139_07d906e62936f0658de18157caf13dcc.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_07d906e62936f0658de18157caf13dcc.jpg saved to cache
2026-03-28 12:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd
2026-03-28 12:05:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd14b150>
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f005e36-16d3-5521-82dc-2e1786c34f8b/0f005e36-16d3-5521-82dc-2e1786c34f8b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F9f%252Fbf9f3989c9a9f3e1d1be9d8f6ba100e0%252Fpa%252FET22397_a4c0c27d827afe18c5890114066de48a.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_a4c0c27d827afe18c5890114066de48a.jpg saved to cache
2026-03-28 12:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0f005e36-16d3-5521-82dc-2e1786c34f8b
2026-03-28 12:05:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3c6b90>
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e101787d-807d-5642-b1ac-827c628c6848/e101787d-807d-5642-b1ac-827c628c6848_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166f747e54bfdda8ced80164d01af69%252Fpa%252FVY27693_02ba9821f6c50442752007e7ae9219bd.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_02ba9821f6c50442752007e7ae9219bd.jpg saved to cache
2026-03-28 12:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e101787d-807d-5642-b1ac-827c628c6848
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc522650>
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5aaec82-c481-5495-bb93-b26eee04f68f/e5aaec82-c481-5495-bb93-b26eee04f68f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F31%252F9531363dcd45a6ba851beb6fa0751092%252Fpa%252FND60676_4be7b7d56628c833fddd92a75f8cabf5.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_4be7b7d56628c833fddd92a75f8cabf5.jpg saved to cache
2026-03-28 12:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e5aaec82-c481-5495-bb93-b26eee04f68f
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc549210>
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f3c9d7a-9924-5552-9d4f-def1cec9be0a/2f3c9d7a-9924-5552-9d4f-def1cec9be0a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F33%252Fc033943d0c928a72af6885f36c6324f5%252Fpa%252FDF10030_9aa3a0d317716312dd6766728e372a01.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_9aa3a0d317716312dd6766728e372a01.jpg saved to cache
2026-03-28 12:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2f3c9d7a-9924-5552-9d4f-def1cec9be0a
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc521ed0>
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5aaec82-c481-5495-bb93-b26eee04f68f/e5aaec82-c481-5495-bb93-b26eee04f68f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F31%252F9531363dcd45a6ba851beb6fa0751092%252Fpa%252FND60676_8d9f473a22ec9ecab371cd9b2140f1f1.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_8d9f473a22ec9ecab371cd9b2140f1f1.jpg saved to cache
2026-03-28 12:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e5aaec82-c481-5495-bb93-b26eee04f68f
2026-03-28 12:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_176216792e42d3a79e2c6dee5f070147.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_8c831ecf6fafe9521d80aa2477b8d14b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_efc8eb7137f1f953ca1cd38d766b0d5c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_ad89a6a973607603d82191bd2d855e02.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_89c68a5f8f498ac45687d13e97be1af8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_4bdc1b8a5d90601cd1b14f336f70f5d0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_317403a24f4725a8c7d81c6aaf914b85.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_d81757ffeefbb8300767506f4d9dfffe.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_30b2e735054146cc49d66287bdc51155.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_39537e6fd76b200b2ae266bda0ea4e58.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3b6c50>
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f3c9d7a-9924-5552-9d4f-def1cec9be0a/2f3c9d7a-9924-5552-9d4f-def1cec9be0a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F33%252Fc033943d0c928a72af6885f36c6324f5%252Fpa%252FDF10030_176216792e42d3a79e2c6dee5f070147.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_176216792e42d3a79e2c6dee5f070147.jpg saved to cache
2026-03-28 12:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2f3c9d7a-9924-5552-9d4f-def1cec9be0a
2026-03-28 12:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/cf/5acfcf4731ae78155bd2055c60c50204/pa/GU07540_7d1c0fe6ef84697a828c4bdecab98a6c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3b22d0>
2026-03-28 12:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f3c9d7a-9924-5552-9d4f-def1cec9be0a/2f3c9d7a-9924-5552-9d4f-def1cec9be0a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F33%252Fc033943d0c928a72af6885f36c6324f5%252Fpa%252FDF10030_8c831ecf6fafe9521d80aa2477b8d14b.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_8c831ecf6fafe9521d80aa2477b8d14b.jpg saved to cache
2026-03-28 12:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2f3c9d7a-9924-5552-9d4f-def1cec9be0a
2026-03-28 12:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_fb7fc651367fba24ce699f494c66beef.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc381dd0>
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f3c9d7a-9924-5552-9d4f-def1cec9be0a/2f3c9d7a-9924-5552-9d4f-def1cec9be0a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F33%252Fc033943d0c928a72af6885f36c6324f5%252Fpa%252FDF10030_efc8eb7137f1f953ca1cd38d766b0d5c.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_efc8eb7137f1f953ca1cd38d766b0d5c.jpg saved to cache
2026-03-28 12:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2f3c9d7a-9924-5552-9d4f-def1cec9be0a
2026-03-28 12:05:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc4dcd10>
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5aaec82-c481-5495-bb93-b26eee04f68f/e5aaec82-c481-5495-bb93-b26eee04f68f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F31%252F9531363dcd45a6ba851beb6fa0751092%252Fpa%252FND60676_ad89a6a973607603d82191bd2d855e02.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_ad89a6a973607603d82191bd2d855e02.jpg saved to cache
2026-03-28 12:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e5aaec82-c481-5495-bb93-b26eee04f68f
2026-03-28 12:05:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3b76d0>
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f3c9d7a-9924-5552-9d4f-def1cec9be0a/2f3c9d7a-9924-5552-9d4f-def1cec9be0a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F33%252Fc033943d0c928a72af6885f36c6324f5%252Fpa%252FDF10030_89c68a5f8f498ac45687d13e97be1af8.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_89c68a5f8f498ac45687d13e97be1af8.jpg saved to cache
2026-03-28 12:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2f3c9d7a-9924-5552-9d4f-def1cec9be0a
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc607390>
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f3c9d7a-9924-5552-9d4f-def1cec9be0a/2f3c9d7a-9924-5552-9d4f-def1cec9be0a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F33%252Fc033943d0c928a72af6885f36c6324f5%252Fpa%252FDF10030_4bdc1b8a5d90601cd1b14f336f70f5d0.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_4bdc1b8a5d90601cd1b14f336f70f5d0.jpg saved to cache
2026-03-28 12:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2f3c9d7a-9924-5552-9d4f-def1cec9be0a
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc377b10>
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f3c9d7a-9924-5552-9d4f-def1cec9be0a/2f3c9d7a-9924-5552-9d4f-def1cec9be0a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F33%252Fc033943d0c928a72af6885f36c6324f5%252Fpa%252FDF10030_317403a24f4725a8c7d81c6aaf914b85.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_317403a24f4725a8c7d81c6aaf914b85.jpg saved to cache
2026-03-28 12:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2f3c9d7a-9924-5552-9d4f-def1cec9be0a
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc382dd0>
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f3c9d7a-9924-5552-9d4f-def1cec9be0a/2f3c9d7a-9924-5552-9d4f-def1cec9be0a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F33%252Fc033943d0c928a72af6885f36c6324f5%252Fpa%252FDF10030_d81757ffeefbb8300767506f4d9dfffe.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_d81757ffeefbb8300767506f4d9dfffe.jpg saved to cache
2026-03-28 12:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2f3c9d7a-9924-5552-9d4f-def1cec9be0a
2026-03-28 12:05:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3b4e10>
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f3c9d7a-9924-5552-9d4f-def1cec9be0a/2f3c9d7a-9924-5552-9d4f-def1cec9be0a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F33%252Fc033943d0c928a72af6885f36c6324f5%252Fpa%252FDF10030_30b2e735054146cc49d66287bdc51155.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_30b2e735054146cc49d66287bdc51155.jpg saved to cache
2026-03-28 12:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2f3c9d7a-9924-5552-9d4f-def1cec9be0a
2026-03-28 12:05:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf67610>
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5aaec82-c481-5495-bb93-b26eee04f68f/e5aaec82-c481-5495-bb93-b26eee04f68f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F31%252F9531363dcd45a6ba851beb6fa0751092%252Fpa%252FND60676_39537e6fd76b200b2ae266bda0ea4e58.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_39537e6fd76b200b2ae266bda0ea4e58.jpg saved to cache
2026-03-28 12:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e5aaec82-c481-5495-bb93-b26eee04f68f
2026-03-28 12:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_cff841913ade50b96a8b4f633aa469c1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_6d3369feb6910ef07af8ee73b094e7a6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bceaf1d0>
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_088d57a3-5af2-5c36-a990-35ce8808940e/088d57a3-5af2-5c36-a990-35ce8808940e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fcf%252F5acfcf4731ae78155bd2055c60c50204%252Fpa%252FGU07540_7d1c0fe6ef84697a828c4bdecab98a6c.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/cf/5acfcf4731ae78155bd2055c60c50204/pa/GU07540_7d1c0fe6ef84697a828c4bdecab98a6c.jpg saved to cache
2026-03-28 12:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 088d57a3-5af2-5c36-a990-35ce8808940e
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf3bc50>
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5aaec82-c481-5495-bb93-b26eee04f68f/e5aaec82-c481-5495-bb93-b26eee04f68f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F31%252F9531363dcd45a6ba851beb6fa0751092%252Fpa%252FND60676_fb7fc651367fba24ce699f494c66beef.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_fb7fc651367fba24ce699f494c66beef.jpg saved to cache
2026-03-28 12:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e5aaec82-c481-5495-bb93-b26eee04f68f
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bceafd50>
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5aaec82-c481-5495-bb93-b26eee04f68f/e5aaec82-c481-5495-bb93-b26eee04f68f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F31%252F9531363dcd45a6ba851beb6fa0751092%252Fpa%252FND60676_cff841913ade50b96a8b4f633aa469c1.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_cff841913ade50b96a8b4f633aa469c1.jpg saved to cache
2026-03-28 12:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e5aaec82-c481-5495-bb93-b26eee04f68f
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf27690>
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5aaec82-c481-5495-bb93-b26eee04f68f/e5aaec82-c481-5495-bb93-b26eee04f68f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F31%252F9531363dcd45a6ba851beb6fa0751092%252Fpa%252FND60676_6d3369feb6910ef07af8ee73b094e7a6.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_6d3369feb6910ef07af8ee73b094e7a6.jpg saved to cache
2026-03-28 12:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e5aaec82-c481-5495-bb93-b26eee04f68f
2026-03-28 12:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_cb842f0c3a42f688cff135d282b1e389.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/cf/5acfcf4731ae78155bd2055c60c50204/pa/GU07540_cc42a330fed60da52cf41de31fb89e1c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_57dab2ce5a899cde238fee84ff5e31c6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_66b8ac40d01c213d3fd2810ba22aeafa.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_5cedaf22d1fe3e750ca01cc8100271d2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_408bfc0db5ffe3db5378cd2bc243b2be.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_f4c94bc529d34b9d2e53ca5374436dae.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_959a0921adc705a9448cc3b7d4d356f8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_0f0d31b047dabe25c0c9bc7c2424cf1f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc54e1d0>
2026-03-28 12:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd/65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F00%252F1900fee19e0209ec751035b1964e0511%252Fpa%252FRT68139_cb842f0c3a42f688cff135d282b1e389.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_cb842f0c3a42f688cff135d282b1e389.jpg saved to cache
2026-03-28 12:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd
2026-03-28 12:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_3844650179c50636d445d1b010541e30.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bf1c3d90>
2026-03-28 12:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_088d57a3-5af2-5c36-a990-35ce8808940e/088d57a3-5af2-5c36-a990-35ce8808940e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fcf%252F5acfcf4731ae78155bd2055c60c50204%252Fpa%252FGU07540_cc42a330fed60da52cf41de31fb89e1c.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/cf/5acfcf4731ae78155bd2055c60c50204/pa/GU07540_cc42a330fed60da52cf41de31fb89e1c.jpg saved to cache
2026-03-28 12:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 088d57a3-5af2-5c36-a990-35ce8808940e
2026-03-28 12:05:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 088d57a3-5af2-5c36-a990-35ce8808940e, skipping ID generation
2026-03-28 12:05:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 088d57a3-5af2-5c36-a990-35ce8808940e with scrape type 1
2026-03-28 12:05:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 088d57a3-5af2-5c36-a990-35ce8808940e sending to next pipeline
2026-03-28 12:05:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 088d57a3-5af2-5c36-a990-35ce8808940e, identifier: GU07540
2026-03-28 12:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_ce859725ff0100e422913f9f2e7832e6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 088d57a3-5af2-5c36-a990-35ce8808940e with identifier: GU07540
2026-03-28 12:05:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 088d57a3-5af2-5c36-a990-35ce8808940e with identifier: GU07540
2026-03-28 12:05:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 088d57a3-5af2-5c36-a990-35ce8808940e with identifier: GU07540 to the API
2026-03-28 12:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5a/cf/5acfcf4731ae78155bd2055c60c50204/pa/GU07540_cc42a330fed60da52cf41de31fb89e1c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:59:29Z',
 'fuel_type': 'petrol',
 'id': '088d57a3-5af2-5c36-a990-35ce8808940e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU07540',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 122878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_088d57a3-5af2-5c36-a990-35ce8808940e/088d57a3-5af2-5c36-a990-35ce8808940e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/cf/5acfcf4731ae78155bd2055c60c50204/pa/GU07540_a954de472c8e23e353f445e63963c9cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_088d57a3-5af2-5c36-a990-35ce8808940e/088d57a3-5af2-5c36-a990-35ce8808940e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/cf/5acfcf4731ae78155bd2055c60c50204/pa/GU07540_cc42a330fed60da52cf41de31fb89e1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_088d57a3-5af2-5c36-a990-35ce8808940e/088d57a3-5af2-5c36-a990-35ce8808940e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/cf/5acfcf4731ae78155bd2055c60c50204/pa/GU07540_f32ba41ad3a976c03ab748d6663f91b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_088d57a3-5af2-5c36-a990-35ce8808940e/088d57a3-5af2-5c36-a990-35ce8808940e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/cf/5acfcf4731ae78155bd2055c60c50204/pa/GU07540_b4e201f8b06aaf131d23422882fe9ce3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_088d57a3-5af2-5c36-a990-35ce8808940e/088d57a3-5af2-5c36-a990-35ce8808940e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/cf/5acfcf4731ae78155bd2055c60c50204/pa/GU07540_7d1c0fe6ef84697a828c4bdecab98a6c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-09-23',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Citroen C1 1.0 Seduction',
 'transmission': 'manual',
 'trim': 'Seduction',
 'year': 2012}
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU07540%27 HTTP/1.1" 200 None
2026-03-28 12:05:46 [auto1.it] INFO: Saving data for GU07540: {'created_time': 1774699546.282674, 'last_price_update_time': 1774699546.282687, 'auction_closing_time': 1774886369.0}
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GU07540') HTTP/1.1" 204 0
2026-03-28 12:05:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bfb63f90>
2026-03-28 12:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f3c9d7a-9924-5552-9d4f-def1cec9be0a/2f3c9d7a-9924-5552-9d4f-def1cec9be0a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F33%252Fc033943d0c928a72af6885f36c6324f5%252Fpa%252FDF10030_57dab2ce5a899cde238fee84ff5e31c6.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_57dab2ce5a899cde238fee84ff5e31c6.jpg saved to cache
2026-03-28 12:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2f3c9d7a-9924-5552-9d4f-def1cec9be0a
2026-03-28 12:05:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2f3c9d7a-9924-5552-9d4f-def1cec9be0a, skipping ID generation
2026-03-28 12:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f3c9d7a-9924-5552-9d4f-def1cec9be0a with scrape type 1
2026-03-28 12:05:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2f3c9d7a-9924-5552-9d4f-def1cec9be0a sending to next pipeline
2026-03-28 12:05:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2f3c9d7a-9924-5552-9d4f-def1cec9be0a, identifier: DF10030
2026-03-28 12:05:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3e7b90>
2026-03-28 12:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5aaec82-c481-5495-bb93-b26eee04f68f/e5aaec82-c481-5495-bb93-b26eee04f68f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F31%252F9531363dcd45a6ba851beb6fa0751092%252Fpa%252FND60676_66b8ac40d01c213d3fd2810ba22aeafa.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_66b8ac40d01c213d3fd2810ba22aeafa.jpg saved to cache
2026-03-28 12:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e5aaec82-c481-5495-bb93-b26eee04f68f
2026-03-28 12:05:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfb3990>
2026-03-28 12:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5aaec82-c481-5495-bb93-b26eee04f68f/e5aaec82-c481-5495-bb93-b26eee04f68f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F31%252F9531363dcd45a6ba851beb6fa0751092%252Fpa%252FND60676_5cedaf22d1fe3e750ca01cc8100271d2.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_5cedaf22d1fe3e750ca01cc8100271d2.jpg saved to cache
2026-03-28 12:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e5aaec82-c481-5495-bb93-b26eee04f68f
2026-03-28 12:05:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3bcb50>
2026-03-28 12:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5aaec82-c481-5495-bb93-b26eee04f68f/e5aaec82-c481-5495-bb93-b26eee04f68f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F31%252F9531363dcd45a6ba851beb6fa0751092%252Fpa%252FND60676_408bfc0db5ffe3db5378cd2bc243b2be.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_408bfc0db5ffe3db5378cd2bc243b2be.jpg saved to cache
2026-03-28 12:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e5aaec82-c481-5495-bb93-b26eee04f68f
2026-03-28 12:05:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e5aaec82-c481-5495-bb93-b26eee04f68f, skipping ID generation
2026-03-28 12:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5aaec82-c481-5495-bb93-b26eee04f68f with scrape type 1
2026-03-28 12:05:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e5aaec82-c481-5495-bb93-b26eee04f68f sending to next pipeline
2026-03-28 12:05:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e5aaec82-c481-5495-bb93-b26eee04f68f, identifier: ND60676
2026-03-28 12:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf39f10>
2026-03-28 12:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd/65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F00%252F1900fee19e0209ec751035b1964e0511%252Fpa%252FRT68139_f4c94bc529d34b9d2e53ca5374436dae.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_f4c94bc529d34b9d2e53ca5374436dae.jpg saved to cache
2026-03-28 12:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd
2026-03-28 12:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_2767a6c251bc510038db0f363c28c3a6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2f3c9d7a-9924-5552-9d4f-def1cec9be0a with identifier: DF10030
2026-03-28 12:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2f3c9d7a-9924-5552-9d4f-def1cec9be0a with identifier: DF10030
2026-03-28 12:05:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2f3c9d7a-9924-5552-9d4f-def1cec9be0a with identifier: DF10030 to the API
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_57dab2ce5a899cde238fee84ff5e31c6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 230,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 255,
 'expiration_date': '2026-03-30T15:16:41Z',
 'fuel_type': 'diesel',
 'id': '2f3c9d7a-9924-5552-9d4f-def1cec9be0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF10030',
 'listing': 'auction',
 'location': 'IT, Firenze',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 110898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f3c9d7a-9924-5552-9d4f-def1cec9be0a/2f3c9d7a-9924-5552-9d4f-def1cec9be0a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2800743,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_efc8eb7137f1f953ca1cd38d766b0d5c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f3c9d7a-9924-5552-9d4f-def1cec9be0a/2f3c9d7a-9924-5552-9d4f-def1cec9be0a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68934,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_d81757ffeefbb8300767506f4d9dfffe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f3c9d7a-9924-5552-9d4f-def1cec9be0a/2f3c9d7a-9924-5552-9d4f-def1cec9be0a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2432170,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_8c831ecf6fafe9521d80aa2477b8d14b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f3c9d7a-9924-5552-9d4f-def1cec9be0a/2f3c9d7a-9924-5552-9d4f-def1cec9be0a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2397701,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_176216792e42d3a79e2c6dee5f070147.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f3c9d7a-9924-5552-9d4f-def1cec9be0a/2f3c9d7a-9924-5552-9d4f-def1cec9be0a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2408862,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_30b2e735054146cc49d66287bdc51155.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f3c9d7a-9924-5552-9d4f-def1cec9be0a/2f3c9d7a-9924-5552-9d4f-def1cec9be0a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75116,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_9aa3a0d317716312dd6766728e372a01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f3c9d7a-9924-5552-9d4f-def1cec9be0a/2f3c9d7a-9924-5552-9d4f-def1cec9be0a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2507266,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_89c68a5f8f498ac45687d13e97be1af8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f3c9d7a-9924-5552-9d4f-def1cec9be0a/2f3c9d7a-9924-5552-9d4f-def1cec9be0a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2516140,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_57dab2ce5a899cde238fee84ff5e31c6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f3c9d7a-9924-5552-9d4f-def1cec9be0a/2f3c9d7a-9924-5552-9d4f-def1cec9be0a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79114,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_4bdc1b8a5d90601cd1b14f336f70f5d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f3c9d7a-9924-5552-9d4f-def1cec9be0a/2f3c9d7a-9924-5552-9d4f-def1cec9be0a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/33/c033943d0c928a72af6885f36c6324f5/pa/DF10030_317403a24f4725a8c7d81c6aaf914b85.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-04-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 3.0 TD V6 SDV6 HSE',
 'transmission': 'automatic',
 'trim': 'SDV6 HSE',
 'year': 2013}
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF10030%27 HTTP/1.1" 200 None
2026-03-28 12:05:47 [auto1.it] INFO: Saving data for DF10030: {'created_time': 1774699547.352542, 'last_price_update_time': 1774699547.352554, 'auction_closing_time': 1774883801.0}
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DF10030') HTTP/1.1" 204 0
2026-03-28 12:05:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e5aaec82-c481-5495-bb93-b26eee04f68f with identifier: ND60676
2026-03-28 12:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e5aaec82-c481-5495-bb93-b26eee04f68f with identifier: ND60676
2026-03-28 12:05:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e5aaec82-c481-5495-bb93-b26eee04f68f with identifier: ND60676 to the API
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_408bfc0db5ffe3db5378cd2bc243b2be.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:45:03Z',
 'fuel_type': 'petrol',
 'id': 'e5aaec82-c481-5495-bb93-b26eee04f68f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND60676',
 'listing': 'auction',
 'location': 'IT, San Giovanni Teatino',
 'make': 'Fiat',
 'model': '500',
 'odometer': 117430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5aaec82-c481-5495-bb93-b26eee04f68f/e5aaec82-c481-5495-bb93-b26eee04f68f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3181127,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_408bfc0db5ffe3db5378cd2bc243b2be.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5aaec82-c481-5495-bb93-b26eee04f68f/e5aaec82-c481-5495-bb93-b26eee04f68f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_6d3369feb6910ef07af8ee73b094e7a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5aaec82-c481-5495-bb93-b26eee04f68f/e5aaec82-c481-5495-bb93-b26eee04f68f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_cff841913ade50b96a8b4f633aa469c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5aaec82-c481-5495-bb93-b26eee04f68f/e5aaec82-c481-5495-bb93-b26eee04f68f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_4be7b7d56628c833fddd92a75f8cabf5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5aaec82-c481-5495-bb93-b26eee04f68f/e5aaec82-c481-5495-bb93-b26eee04f68f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2791139,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_39537e6fd76b200b2ae266bda0ea4e58.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5aaec82-c481-5495-bb93-b26eee04f68f/e5aaec82-c481-5495-bb93-b26eee04f68f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_8d9f473a22ec9ecab371cd9b2140f1f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5aaec82-c481-5495-bb93-b26eee04f68f/e5aaec82-c481-5495-bb93-b26eee04f68f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2158046,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_ad89a6a973607603d82191bd2d855e02.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5aaec82-c481-5495-bb93-b26eee04f68f/e5aaec82-c481-5495-bb93-b26eee04f68f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2758174,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_66b8ac40d01c213d3fd2810ba22aeafa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5aaec82-c481-5495-bb93-b26eee04f68f/e5aaec82-c481-5495-bb93-b26eee04f68f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2896883,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_5cedaf22d1fe3e750ca01cc8100271d2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5aaec82-c481-5495-bb93-b26eee04f68f/e5aaec82-c481-5495-bb93-b26eee04f68f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/31/9531363dcd45a6ba851beb6fa0751092/pa/ND60676_fb7fc651367fba24ce699f494c66beef.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-07-28',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2013}
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ND60676%27 HTTP/1.1" 200 None
2026-03-28 12:05:47 [auto1.it] INFO: Saving data for ND60676: {'created_time': 1774699547.777703, 'last_price_update_time': 1774699547.777716, 'auction_closing_time': 1774885503.0}
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ND60676') HTTP/1.1" 204 0
2026-03-28 12:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_cd23387eb493df6ddc23452b74f26761.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf04750>
2026-03-28 12:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd/65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F00%252F1900fee19e0209ec751035b1964e0511%252Fpa%252FRT68139_959a0921adc705a9448cc3b7d4d356f8.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_959a0921adc705a9448cc3b7d4d356f8.jpg saved to cache
2026-03-28 12:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd
2026-03-28 12:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf64090>
2026-03-28 12:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd/65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F00%252F1900fee19e0209ec751035b1964e0511%252Fpa%252FRT68139_0f0d31b047dabe25c0c9bc7c2424cf1f.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_0f0d31b047dabe25c0c9bc7c2424cf1f.jpg saved to cache
2026-03-28 12:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd
2026-03-28 12:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3a8150>
2026-03-28 12:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97978bda-0d93-5484-92c8-f1ce53e9d5c2/97978bda-0d93-5484-92c8-f1ce53e9d5c2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F8f%252F4f8f3f6e53cc88a9863b8359d559eb36%252Fpa%252FGC21308_3844650179c50636d445d1b010541e30.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_3844650179c50636d445d1b010541e30.jpg saved to cache
2026-03-28 12:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 97978bda-0d93-5484-92c8-f1ce53e9d5c2
2026-03-28 12:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf65790>
2026-03-28 12:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97978bda-0d93-5484-92c8-f1ce53e9d5c2/97978bda-0d93-5484-92c8-f1ce53e9d5c2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F8f%252F4f8f3f6e53cc88a9863b8359d559eb36%252Fpa%252FGC21308_ce859725ff0100e422913f9f2e7832e6.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_ce859725ff0100e422913f9f2e7832e6.jpg saved to cache
2026-03-28 12:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 97978bda-0d93-5484-92c8-f1ce53e9d5c2
2026-03-28 12:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_1d4dd6cf097152ced5f16220327ca726.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3d9ed0>
2026-03-28 12:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97978bda-0d93-5484-92c8-f1ce53e9d5c2/97978bda-0d93-5484-92c8-f1ce53e9d5c2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F8f%252F4f8f3f6e53cc88a9863b8359d559eb36%252Fpa%252FGC21308_2767a6c251bc510038db0f363c28c3a6.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_2767a6c251bc510038db0f363c28c3a6.jpg saved to cache
2026-03-28 12:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 97978bda-0d93-5484-92c8-f1ce53e9d5c2
2026-03-28 12:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3fee90>
2026-03-28 12:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97978bda-0d93-5484-92c8-f1ce53e9d5c2/97978bda-0d93-5484-92c8-f1ce53e9d5c2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F8f%252F4f8f3f6e53cc88a9863b8359d559eb36%252Fpa%252FGC21308_cd23387eb493df6ddc23452b74f26761.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_cd23387eb493df6ddc23452b74f26761.jpg saved to cache
2026-03-28 12:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 97978bda-0d93-5484-92c8-f1ce53e9d5c2
2026-03-28 12:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3f7c90>
2026-03-28 12:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dcf2a9c-dbdc-5011-830a-9f40907f3173/5dcf2a9c-dbdc-5011-830a-9f40907f3173_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff9%252F35f9837c493f6daf1a433b99a731a16d%252Fpa%252FSB06120_1d4dd6cf097152ced5f16220327ca726.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_1d4dd6cf097152ced5f16220327ca726.jpg saved to cache
2026-03-28 12:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5dcf2a9c-dbdc-5011-830a-9f40907f3173
2026-03-28 12:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/96/0f9646a6cfd213c4cee53277aa5b9b3d/pa/WN69179_7c4a903623fcee5fdc79d63909a19e40.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_a464400fd3d1ed8a98824849c73a41b1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_84a87d064260fec20b869ba4d9794ba4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_96d4d06c6e2c2084806515db219c22a1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_f0e75da8b32f13394a1cf6fb367204c6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_4f524dd7936f291724e2b5ebadb7ad81.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_439a724e2f561c19aae59e8df4cbfabc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_f43f5296d00689daf6149ca87d5c84de.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc65ed10>
2026-03-28 12:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4fa818f-fb69-545b-978b-23bcaecd0161/a4fa818f-fb69-545b-978b-23bcaecd0161_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F96%252F0f9646a6cfd213c4cee53277aa5b9b3d%252Fpa%252FWN69179_7c4a903623fcee5fdc79d63909a19e40.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/96/0f9646a6cfd213c4cee53277aa5b9b3d/pa/WN69179_7c4a903623fcee5fdc79d63909a19e40.jpg saved to cache
2026-03-28 12:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a4fa818f-fb69-545b-978b-23bcaecd0161
2026-03-28 12:05:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a4fa818f-fb69-545b-978b-23bcaecd0161, skipping ID generation
2026-03-28 12:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4fa818f-fb69-545b-978b-23bcaecd0161 with scrape type 1
2026-03-28 12:05:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a4fa818f-fb69-545b-978b-23bcaecd0161 sending to next pipeline
2026-03-28 12:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a4fa818f-fb69-545b-978b-23bcaecd0161, identifier: WN69179
2026-03-28 12:05:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a4fa818f-fb69-545b-978b-23bcaecd0161 with identifier: WN69179
2026-03-28 12:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a4fa818f-fb69-545b-978b-23bcaecd0161 with identifier: WN69179
2026-03-28 12:05:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a4fa818f-fb69-545b-978b-23bcaecd0161 with identifier: WN69179 to the API
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0f/96/0f9646a6cfd213c4cee53277aa5b9b3d/pa/WN69179_7c4a903623fcee5fdc79d63909a19e40.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:07:50Z',
 'fuel_type': 'petrol',
 'id': 'a4fa818f-fb69-545b-978b-23bcaecd0161',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN69179',
 'listing': 'auction',
 'location': 'IT, Villasanta',
 'make': 'Fiat',
 'model': '500',
 'odometer': 162853,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4fa818f-fb69-545b-978b-23bcaecd0161/a4fa818f-fb69-545b-978b-23bcaecd0161_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/96/0f9646a6cfd213c4cee53277aa5b9b3d/pa/WN69179_7c4a903623fcee5fdc79d63909a19e40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4fa818f-fb69-545b-978b-23bcaecd0161/a4fa818f-fb69-545b-978b-23bcaecd0161_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/96/0f9646a6cfd213c4cee53277aa5b9b3d/pa/WN69179_3d063739835f34fcaecddb48888c8cb6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4fa818f-fb69-545b-978b-23bcaecd0161/a4fa818f-fb69-545b-978b-23bcaecd0161_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/96/0f9646a6cfd213c4cee53277aa5b9b3d/pa/WN69179_daf71623c49069be5b49d58db344b1a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4fa818f-fb69-545b-978b-23bcaecd0161/a4fa818f-fb69-545b-978b-23bcaecd0161_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/96/0f9646a6cfd213c4cee53277aa5b9b3d/pa/WN69179_bbaf443aeda8049cd8d859ab589d8513.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4fa818f-fb69-545b-978b-23bcaecd0161/a4fa818f-fb69-545b-978b-23bcaecd0161_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65535,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/96/0f9646a6cfd213c4cee53277aa5b9b3d/pa/WN69179_e0b4c81ef53bb6c49f3b2f1746154cec.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-06-15',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2009}
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN69179%27 HTTP/1.1" 200 None
2026-03-28 12:05:48 [auto1.it] INFO: Saving data for WN69179: {'created_time': 1774699548.800788, 'last_price_update_time': 1774699548.800803, 'auction_closing_time': 1774883270.0}
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WN69179') HTTP/1.1" 204 0
2026-03-28 12:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_5c7ca62904cd691e8fa3e3ed999bfce9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_23c4976bb91a40aae15430ce80f486dd.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3fc890>
2026-03-28 12:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97978bda-0d93-5484-92c8-f1ce53e9d5c2/97978bda-0d93-5484-92c8-f1ce53e9d5c2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F8f%252F4f8f3f6e53cc88a9863b8359d559eb36%252Fpa%252FGC21308_a464400fd3d1ed8a98824849c73a41b1.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_a464400fd3d1ed8a98824849c73a41b1.jpg saved to cache
2026-03-28 12:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 97978bda-0d93-5484-92c8-f1ce53e9d5c2
2026-03-28 12:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_b49d0e2684112026d9cf32ea0a4461f3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc402e50>
2026-03-28 12:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97978bda-0d93-5484-92c8-f1ce53e9d5c2/97978bda-0d93-5484-92c8-f1ce53e9d5c2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F8f%252F4f8f3f6e53cc88a9863b8359d559eb36%252Fpa%252FGC21308_84a87d064260fec20b869ba4d9794ba4.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_84a87d064260fec20b869ba4d9794ba4.jpg saved to cache
2026-03-28 12:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 97978bda-0d93-5484-92c8-f1ce53e9d5c2
2026-03-28 12:05:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3f4590>
2026-03-28 12:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dcf2a9c-dbdc-5011-830a-9f40907f3173/5dcf2a9c-dbdc-5011-830a-9f40907f3173_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff9%252F35f9837c493f6daf1a433b99a731a16d%252Fpa%252FSB06120_96d4d06c6e2c2084806515db219c22a1.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_96d4d06c6e2c2084806515db219c22a1.jpg saved to cache
2026-03-28 12:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5dcf2a9c-dbdc-5011-830a-9f40907f3173
2026-03-28 12:05:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc65d450>
2026-03-28 12:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dcf2a9c-dbdc-5011-830a-9f40907f3173/5dcf2a9c-dbdc-5011-830a-9f40907f3173_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff9%252F35f9837c493f6daf1a433b99a731a16d%252Fpa%252FSB06120_f0e75da8b32f13394a1cf6fb367204c6.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_f0e75da8b32f13394a1cf6fb367204c6.jpg saved to cache
2026-03-28 12:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5dcf2a9c-dbdc-5011-830a-9f40907f3173
2026-03-28 12:05:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5ee650>
2026-03-28 12:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97978bda-0d93-5484-92c8-f1ce53e9d5c2/97978bda-0d93-5484-92c8-f1ce53e9d5c2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F8f%252F4f8f3f6e53cc88a9863b8359d559eb36%252Fpa%252FGC21308_4f524dd7936f291724e2b5ebadb7ad81.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_4f524dd7936f291724e2b5ebadb7ad81.jpg saved to cache
2026-03-28 12:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 97978bda-0d93-5484-92c8-f1ce53e9d5c2
2026-03-28 12:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd04a650>
2026-03-28 12:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd/65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F00%252F1900fee19e0209ec751035b1964e0511%252Fpa%252FRT68139_439a724e2f561c19aae59e8df4cbfabc.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_439a724e2f561c19aae59e8df4cbfabc.jpg saved to cache
2026-03-28 12:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd
2026-03-28 12:05:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd, skipping ID generation
2026-03-28 12:05:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd with scrape type 1
2026-03-28 12:05:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd sending to next pipeline
2026-03-28 12:05:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd, identifier: RT68139
2026-03-28 12:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf39c50>
2026-03-28 12:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f005e36-16d3-5521-82dc-2e1786c34f8b/0f005e36-16d3-5521-82dc-2e1786c34f8b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F9f%252Fbf9f3989c9a9f3e1d1be9d8f6ba100e0%252Fpa%252FET22397_f43f5296d00689daf6149ca87d5c84de.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_f43f5296d00689daf6149ca87d5c84de.jpg saved to cache
2026-03-28 12:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0f005e36-16d3-5521-82dc-2e1786c34f8b
2026-03-28 12:05:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd with identifier: RT68139
2026-03-28 12:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd with identifier: RT68139
2026-03-28 12:05:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd with identifier: RT68139 to the API
2026-03-28 12:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_439a724e2f561c19aae59e8df4cbfabc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:08:51Z',
 'fuel_type': 'diesel',
 'id': '65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT68139',
 'listing': 'auction',
 'location': 'IT, San Giuliano Milanese',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 178298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd/65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_439a724e2f561c19aae59e8df4cbfabc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd/65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_da172acf9b758d08fcb9831f114ad9e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd/65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_784480eae4f448f3394d92c30c086edd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd/65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82673,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_959a0921adc705a9448cc3b7d4d356f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd/65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_0f0d31b047dabe25c0c9bc7c2424cf1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd/65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93336,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_b117b5f334370669fdc4d59e302059b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd/65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67673,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_fd7aeaec7c35da2c264bb179aa005311.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd/65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_f4c94bc529d34b9d2e53ca5374436dae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd/65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_07d906e62936f0658de18157caf13dcc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd/65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/00/1900fee19e0209ec751035b1964e0511/pa/RT68139_cb842f0c3a42f688cff135d282b1e389.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2017}
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT68139%27 HTTP/1.1" 200 None
2026-03-28 12:05:50 [auto1.it] INFO: Saving data for RT68139: {'created_time': 1774699550.126643, 'last_price_update_time': 1774699550.12666, 'auction_closing_time': 1774883331.0}
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RT68139') HTTP/1.1" 204 0
2026-03-28 12:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_f08c6be3580ae3fa32690e259a75a159.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_12f5724cd24a6faa8e59baf2fa0a4278.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04beed2fd0>
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dcf2a9c-dbdc-5011-830a-9f40907f3173/5dcf2a9c-dbdc-5011-830a-9f40907f3173_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff9%252F35f9837c493f6daf1a433b99a731a16d%252Fpa%252FSB06120_5c7ca62904cd691e8fa3e3ed999bfce9.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_5c7ca62904cd691e8fa3e3ed999bfce9.jpg saved to cache
2026-03-28 12:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5dcf2a9c-dbdc-5011-830a-9f40907f3173
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bdd7c8d0>
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dcf2a9c-dbdc-5011-830a-9f40907f3173/5dcf2a9c-dbdc-5011-830a-9f40907f3173_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff9%252F35f9837c493f6daf1a433b99a731a16d%252Fpa%252FSB06120_23c4976bb91a40aae15430ce80f486dd.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_23c4976bb91a40aae15430ce80f486dd.jpg saved to cache
2026-03-28 12:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5dcf2a9c-dbdc-5011-830a-9f40907f3173
2026-03-28 12:05:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd1111d0>
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97978bda-0d93-5484-92c8-f1ce53e9d5c2/97978bda-0d93-5484-92c8-f1ce53e9d5c2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F8f%252F4f8f3f6e53cc88a9863b8359d559eb36%252Fpa%252FGC21308_b49d0e2684112026d9cf32ea0a4461f3.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_b49d0e2684112026d9cf32ea0a4461f3.jpg saved to cache
2026-03-28 12:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 97978bda-0d93-5484-92c8-f1ce53e9d5c2
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf07810>
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f005e36-16d3-5521-82dc-2e1786c34f8b/0f005e36-16d3-5521-82dc-2e1786c34f8b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F9f%252Fbf9f3989c9a9f3e1d1be9d8f6ba100e0%252Fpa%252FET22397_f08c6be3580ae3fa32690e259a75a159.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_f08c6be3580ae3fa32690e259a75a159.jpg saved to cache
2026-03-28 12:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0f005e36-16d3-5521-82dc-2e1786c34f8b
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf25410>
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f005e36-16d3-5521-82dc-2e1786c34f8b/0f005e36-16d3-5521-82dc-2e1786c34f8b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F9f%252Fbf9f3989c9a9f3e1d1be9d8f6ba100e0%252Fpa%252FET22397_12f5724cd24a6faa8e59baf2fa0a4278.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_12f5724cd24a6faa8e59baf2fa0a4278.jpg saved to cache
2026-03-28 12:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0f005e36-16d3-5521-82dc-2e1786c34f8b
2026-03-28 12:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_78ba02911be7d82e8b8c772bce571c97.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_5d7af63742baed0abcab42ba1f27fa7f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_c6365aef697e3b92702acca80d6e3504.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_18dcabc0e381dc319beede3c922bec20.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_e520b26b6789838c3a70583738350672.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_5c6a216fb2a03d66bb6c90961206ccee.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_e939c748ea1e415841e2f7f36f237aba.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_6d0ff5593064e03ca32900660016e78b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/92/73928da73745969342cf8ac13fbe47d4/pa/ET05908_f9d45a6559b448e66515c963d1b6c659.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/92/73928da73745969342cf8ac13fbe47d4/pa/ET05908_2ce948899f2c046305ba0428a354ff7a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3d5410>
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dcf2a9c-dbdc-5011-830a-9f40907f3173/5dcf2a9c-dbdc-5011-830a-9f40907f3173_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff9%252F35f9837c493f6daf1a433b99a731a16d%252Fpa%252FSB06120_78ba02911be7d82e8b8c772bce571c97.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_78ba02911be7d82e8b8c772bce571c97.jpg saved to cache
2026-03-28 12:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5dcf2a9c-dbdc-5011-830a-9f40907f3173
2026-03-28 12:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_e55530dcbd3da55513954fb98fe50c9e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3c7550>
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e101787d-807d-5642-b1ac-827c628c6848/e101787d-807d-5642-b1ac-827c628c6848_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166f747e54bfdda8ced80164d01af69%252Fpa%252FVY27693_5d7af63742baed0abcab42ba1f27fa7f.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_5d7af63742baed0abcab42ba1f27fa7f.jpg saved to cache
2026-03-28 12:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e101787d-807d-5642-b1ac-827c628c6848
2026-03-28 12:05:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc409810>
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dcf2a9c-dbdc-5011-830a-9f40907f3173/5dcf2a9c-dbdc-5011-830a-9f40907f3173_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff9%252F35f9837c493f6daf1a433b99a731a16d%252Fpa%252FSB06120_c6365aef697e3b92702acca80d6e3504.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_c6365aef697e3b92702acca80d6e3504.jpg saved to cache
2026-03-28 12:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5dcf2a9c-dbdc-5011-830a-9f40907f3173
2026-03-28 12:05:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5dcf2a9c-dbdc-5011-830a-9f40907f3173, skipping ID generation
2026-03-28 12:05:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dcf2a9c-dbdc-5011-830a-9f40907f3173 with scrape type 1
2026-03-28 12:05:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5dcf2a9c-dbdc-5011-830a-9f40907f3173 sending to next pipeline
2026-03-28 12:05:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5dcf2a9c-dbdc-5011-830a-9f40907f3173, identifier: SB06120
2026-03-28 12:05:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd13e710>
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e101787d-807d-5642-b1ac-827c628c6848/e101787d-807d-5642-b1ac-827c628c6848_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166f747e54bfdda8ced80164d01af69%252Fpa%252FVY27693_18dcabc0e381dc319beede3c922bec20.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_18dcabc0e381dc319beede3c922bec20.jpg saved to cache
2026-03-28 12:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e101787d-807d-5642-b1ac-827c628c6848
2026-03-28 12:05:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5a9c90>
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f005e36-16d3-5521-82dc-2e1786c34f8b/0f005e36-16d3-5521-82dc-2e1786c34f8b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F9f%252Fbf9f3989c9a9f3e1d1be9d8f6ba100e0%252Fpa%252FET22397_e520b26b6789838c3a70583738350672.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_e520b26b6789838c3a70583738350672.jpg saved to cache
2026-03-28 12:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0f005e36-16d3-5521-82dc-2e1786c34f8b
2026-03-28 12:05:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3c5890>
2026-03-28 12:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e101787d-807d-5642-b1ac-827c628c6848/e101787d-807d-5642-b1ac-827c628c6848_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166f747e54bfdda8ced80164d01af69%252Fpa%252FVY27693_5c6a216fb2a03d66bb6c90961206ccee.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_5c6a216fb2a03d66bb6c90961206ccee.jpg saved to cache
2026-03-28 12:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e101787d-807d-5642-b1ac-827c628c6848
2026-03-28 12:05:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc385090>
2026-03-28 12:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97978bda-0d93-5484-92c8-f1ce53e9d5c2/97978bda-0d93-5484-92c8-f1ce53e9d5c2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F8f%252F4f8f3f6e53cc88a9863b8359d559eb36%252Fpa%252FGC21308_e939c748ea1e415841e2f7f36f237aba.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_e939c748ea1e415841e2f7f36f237aba.jpg saved to cache
2026-03-28 12:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97978bda-0d93-5484-92c8-f1ce53e9d5c2
2026-03-28 12:05:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 97978bda-0d93-5484-92c8-f1ce53e9d5c2, skipping ID generation
2026-03-28 12:05:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97978bda-0d93-5484-92c8-f1ce53e9d5c2 with scrape type 1
2026-03-28 12:05:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 97978bda-0d93-5484-92c8-f1ce53e9d5c2 sending to next pipeline
2026-03-28 12:05:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 97978bda-0d93-5484-92c8-f1ce53e9d5c2, identifier: GC21308
2026-03-28 12:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04beec4a10>
2026-03-28 12:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e101787d-807d-5642-b1ac-827c628c6848/e101787d-807d-5642-b1ac-827c628c6848_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166f747e54bfdda8ced80164d01af69%252Fpa%252FVY27693_6d0ff5593064e03ca32900660016e78b.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_6d0ff5593064e03ca32900660016e78b.jpg saved to cache
2026-03-28 12:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e101787d-807d-5642-b1ac-827c628c6848
2026-03-28 12:05:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e101787d-807d-5642-b1ac-827c628c6848, skipping ID generation
2026-03-28 12:05:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e101787d-807d-5642-b1ac-827c628c6848 with scrape type 1
2026-03-28 12:05:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e101787d-807d-5642-b1ac-827c628c6848 sending to next pipeline
2026-03-28 12:05:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e101787d-807d-5642-b1ac-827c628c6848, identifier: VY27693
2026-03-28 12:05:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5dcf2a9c-dbdc-5011-830a-9f40907f3173 with identifier: SB06120
2026-03-28 12:05:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5dcf2a9c-dbdc-5011-830a-9f40907f3173 with identifier: SB06120
2026-03-28 12:05:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5dcf2a9c-dbdc-5011-830a-9f40907f3173 with identifier: SB06120 to the API
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_c6365aef697e3b92702acca80d6e3504.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '0.9L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:05:02Z',
 'fuel_type': 'petrol',
 'id': '5dcf2a9c-dbdc-5011-830a-9f40907f3173',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB06120',
 'listing': 'auction',
 'location': 'IT, Casoria',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 65325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dcf2a9c-dbdc-5011-830a-9f40907f3173/5dcf2a9c-dbdc-5011-830a-9f40907f3173_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_78ba02911be7d82e8b8c772bce571c97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dcf2a9c-dbdc-5011-830a-9f40907f3173/5dcf2a9c-dbdc-5011-830a-9f40907f3173_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2481554,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_1cd92b84b0bf579af340ab40ab8e171b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dcf2a9c-dbdc-5011-830a-9f40907f3173/5dcf2a9c-dbdc-5011-830a-9f40907f3173_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_4a4d37b82a0d7d2eaffab8489c435f91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dcf2a9c-dbdc-5011-830a-9f40907f3173/5dcf2a9c-dbdc-5011-830a-9f40907f3173_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62854,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_23c4976bb91a40aae15430ce80f486dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dcf2a9c-dbdc-5011-830a-9f40907f3173/5dcf2a9c-dbdc-5011-830a-9f40907f3173_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_8773dda2c8fb99fb00617af524941371.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dcf2a9c-dbdc-5011-830a-9f40907f3173/5dcf2a9c-dbdc-5011-830a-9f40907f3173_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2406151,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_c6365aef697e3b92702acca80d6e3504.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dcf2a9c-dbdc-5011-830a-9f40907f3173/5dcf2a9c-dbdc-5011-830a-9f40907f3173_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_5c7ca62904cd691e8fa3e3ed999bfce9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dcf2a9c-dbdc-5011-830a-9f40907f3173/5dcf2a9c-dbdc-5011-830a-9f40907f3173_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_1d4dd6cf097152ced5f16220327ca726.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dcf2a9c-dbdc-5011-830a-9f40907f3173/5dcf2a9c-dbdc-5011-830a-9f40907f3173_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2250792,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_f0e75da8b32f13394a1cf6fb367204c6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dcf2a9c-dbdc-5011-830a-9f40907f3173/5dcf2a9c-dbdc-5011-830a-9f40907f3173_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2674249,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f9/35f9837c493f6daf1a433b99a731a16d/pa/SB06120_96d4d06c6e2c2084806515db219c22a1.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Panda 0.9 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2013}
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB06120%27 HTTP/1.1" 200 None
2026-03-28 12:05:51 [auto1.it] INFO: Saving data for SB06120: {'created_time': 1774699551.852851, 'last_price_update_time': 1774699551.852859, 'auction_closing_time': 1774883102.0}
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SB06120') HTTP/1.1" 204 0
2026-03-28 12:05:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 97978bda-0d93-5484-92c8-f1ce53e9d5c2 with identifier: GC21308
2026-03-28 12:05:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 97978bda-0d93-5484-92c8-f1ce53e9d5c2 with identifier: GC21308
2026-03-28 12:05:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 97978bda-0d93-5484-92c8-f1ce53e9d5c2 with identifier: GC21308 to the API
2026-03-28 12:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_e939c748ea1e415841e2f7f36f237aba.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 111,
 'expiration_date': '2026-03-30T15:55:51Z',
 'fuel_type': 'petrol',
 'id': '97978bda-0d93-5484-92c8-f1ce53e9d5c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC21308',
 'listing': 'auction',
 'location': 'IT, Roma RM',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 173534,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97978bda-0d93-5484-92c8-f1ce53e9d5c2/97978bda-0d93-5484-92c8-f1ce53e9d5c2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3609402,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_e939c748ea1e415841e2f7f36f237aba.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97978bda-0d93-5484-92c8-f1ce53e9d5c2/97978bda-0d93-5484-92c8-f1ce53e9d5c2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_b49d0e2684112026d9cf32ea0a4461f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97978bda-0d93-5484-92c8-f1ce53e9d5c2/97978bda-0d93-5484-92c8-f1ce53e9d5c2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_cd23387eb493df6ddc23452b74f26761.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97978bda-0d93-5484-92c8-f1ce53e9d5c2/97978bda-0d93-5484-92c8-f1ce53e9d5c2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2585901,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_a464400fd3d1ed8a98824849c73a41b1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97978bda-0d93-5484-92c8-f1ce53e9d5c2/97978bda-0d93-5484-92c8-f1ce53e9d5c2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3164744,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_4f524dd7936f291724e2b5ebadb7ad81.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97978bda-0d93-5484-92c8-f1ce53e9d5c2/97978bda-0d93-5484-92c8-f1ce53e9d5c2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_276488da870f8d6ea37f855dba9e700d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97978bda-0d93-5484-92c8-f1ce53e9d5c2/97978bda-0d93-5484-92c8-f1ce53e9d5c2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2618376,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_84a87d064260fec20b869ba4d9794ba4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97978bda-0d93-5484-92c8-f1ce53e9d5c2/97978bda-0d93-5484-92c8-f1ce53e9d5c2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_2767a6c251bc510038db0f363c28c3a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97978bda-0d93-5484-92c8-f1ce53e9d5c2/97978bda-0d93-5484-92c8-f1ce53e9d5c2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_3844650179c50636d445d1b010541e30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97978bda-0d93-5484-92c8-f1ce53e9d5c2/97978bda-0d93-5484-92c8-f1ce53e9d5c2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/8f/4f8f3f6e53cc88a9863b8359d559eb36/pa/GC21308_ce859725ff0100e422913f9f2e7832e6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki Vitara 1.0 BoosterJet Star View 4x2',
 'transmission': 'manual',
 'trim': 'Star View 4x2',
 'year': 2019}
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC21308%27 HTTP/1.1" 200 None
2026-03-28 12:05:52 [auto1.it] INFO: Saving data for GC21308: {'created_time': 1774699552.240307, 'last_price_update_time': 1774699552.240317, 'auction_closing_time': 1774886151.0}
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GC21308') HTTP/1.1" 204 0
2026-03-28 12:05:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e101787d-807d-5642-b1ac-827c628c6848 with identifier: VY27693
2026-03-28 12:05:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e101787d-807d-5642-b1ac-827c628c6848 with identifier: VY27693
2026-03-28 12:05:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e101787d-807d-5642-b1ac-827c628c6848 with identifier: VY27693 to the API
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_6d0ff5593064e03ca32900660016e78b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:37:17Z',
 'fuel_type': 'petrol',
 'id': 'e101787d-807d-5642-b1ac-827c628c6848',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY27693',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 81336,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e101787d-807d-5642-b1ac-827c628c6848/e101787d-807d-5642-b1ac-827c628c6848_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_6d0ff5593064e03ca32900660016e78b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e101787d-807d-5642-b1ac-827c628c6848/e101787d-807d-5642-b1ac-827c628c6848_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2730731,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_02ba9821f6c50442752007e7ae9219bd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e101787d-807d-5642-b1ac-827c628c6848/e101787d-807d-5642-b1ac-827c628c6848_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2804290,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_3f5079f8bb89adf752938f8f71623f43.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e101787d-807d-5642-b1ac-827c628c6848/e101787d-807d-5642-b1ac-827c628c6848_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_c93e57157d4a3821f74b53783294774f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e101787d-807d-5642-b1ac-827c628c6848/e101787d-807d-5642-b1ac-827c628c6848_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_5d7af63742baed0abcab42ba1f27fa7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e101787d-807d-5642-b1ac-827c628c6848/e101787d-807d-5642-b1ac-827c628c6848_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_8be329bdba306f4c755279a6cbd6c797.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e101787d-807d-5642-b1ac-827c628c6848/e101787d-807d-5642-b1ac-827c628c6848_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63183,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_80c67501bf8191431b8ced6d24522e51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e101787d-807d-5642-b1ac-827c628c6848/e101787d-807d-5642-b1ac-827c628c6848_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2678282,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_5c6a216fb2a03d66bb6c90961206ccee.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e101787d-807d-5642-b1ac-827c628c6848/e101787d-807d-5642-b1ac-827c628c6848_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78264,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_9eb800c8c0ff9e13e7a81f2d1e83925f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e101787d-807d-5642-b1ac-827c628c6848/e101787d-807d-5642-b1ac-827c628c6848_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2964254,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/66/f166f747e54bfdda8ced80164d01af69/pa/VY27693_18dcabc0e381dc319beede3c922bec20.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-02-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Kompressor Avantgarde',
 'transmission': 'manual',
 'trim': 'Avantgarde',
 'year': 2008}
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY27693%27 HTTP/1.1" 200 None
2026-03-28 12:05:52 [auto1.it] INFO: Saving data for VY27693: {'created_time': 1774699552.589725, 'last_price_update_time': 1774699552.589735, 'auction_closing_time': 1774885037.0}
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VY27693') HTTP/1.1" 204 0
2026-03-28 12:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcff7750>
2026-03-28 12:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0941f7ce-8192-5540-beaf-6361d966fc21/0941f7ce-8192-5540-beaf-6361d966fc21_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F92%252F73928da73745969342cf8ac13fbe47d4%252Fpa%252FET05908_f9d45a6559b448e66515c963d1b6c659.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/92/73928da73745969342cf8ac13fbe47d4/pa/ET05908_f9d45a6559b448e66515c963d1b6c659.jpg saved to cache
2026-03-28 12:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0941f7ce-8192-5540-beaf-6361d966fc21
2026-03-28 12:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc40da90>
2026-03-28 12:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0941f7ce-8192-5540-beaf-6361d966fc21/0941f7ce-8192-5540-beaf-6361d966fc21_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F92%252F73928da73745969342cf8ac13fbe47d4%252Fpa%252FET05908_2ce948899f2c046305ba0428a354ff7a.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/92/73928da73745969342cf8ac13fbe47d4/pa/ET05908_2ce948899f2c046305ba0428a354ff7a.jpg saved to cache
2026-03-28 12:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0941f7ce-8192-5540-beaf-6361d966fc21
2026-03-28 12:05:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0941f7ce-8192-5540-beaf-6361d966fc21, skipping ID generation
2026-03-28 12:05:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0941f7ce-8192-5540-beaf-6361d966fc21 with scrape type 1
2026-03-28 12:05:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0941f7ce-8192-5540-beaf-6361d966fc21 sending to next pipeline
2026-03-28 12:05:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0941f7ce-8192-5540-beaf-6361d966fc21, identifier: ET05908
2026-03-28 12:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd148110>
2026-03-28 12:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f005e36-16d3-5521-82dc-2e1786c34f8b/0f005e36-16d3-5521-82dc-2e1786c34f8b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F9f%252Fbf9f3989c9a9f3e1d1be9d8f6ba100e0%252Fpa%252FET22397_e55530dcbd3da55513954fb98fe50c9e.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_e55530dcbd3da55513954fb98fe50c9e.jpg saved to cache
2026-03-28 12:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f005e36-16d3-5521-82dc-2e1786c34f8b
2026-03-28 12:05:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0941f7ce-8192-5540-beaf-6361d966fc21 with identifier: ET05908
2026-03-28 12:05:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0941f7ce-8192-5540-beaf-6361d966fc21 with identifier: ET05908
2026-03-28 12:05:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0941f7ce-8192-5540-beaf-6361d966fc21 with identifier: ET05908 to the API
2026-03-28 12:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img73/92/73928da73745969342cf8ac13fbe47d4/pa/ET05908_2ce948899f2c046305ba0428a354ff7a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 224,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:03:57Z',
 'fuel_type': 'diesel',
 'id': '0941f7ce-8192-5540-beaf-6361d966fc21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET05908',
 'listing': 'auction',
 'location': 'IT, Alessandria',
 'make': 'Chevrolet',
 'model': 'Captiva',
 'odometer': 106468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0941f7ce-8192-5540-beaf-6361d966fc21/0941f7ce-8192-5540-beaf-6361d966fc21_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/92/73928da73745969342cf8ac13fbe47d4/pa/ET05908_f9d45a6559b448e66515c963d1b6c659.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0941f7ce-8192-5540-beaf-6361d966fc21/0941f7ce-8192-5540-beaf-6361d966fc21_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/92/73928da73745969342cf8ac13fbe47d4/pa/ET05908_244b3d373ef1eaeb9e546aa99681cafc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0941f7ce-8192-5540-beaf-6361d966fc21/0941f7ce-8192-5540-beaf-6361d966fc21_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77303,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/92/73928da73745969342cf8ac13fbe47d4/pa/ET05908_6f1c72f2025e24fd12d39d0b6e0ce5ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0941f7ce-8192-5540-beaf-6361d966fc21/0941f7ce-8192-5540-beaf-6361d966fc21_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/92/73928da73745969342cf8ac13fbe47d4/pa/ET05908_8af6e3ad1ce8414feb9934ffd9e1f1e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0941f7ce-8192-5540-beaf-6361d966fc21/0941f7ce-8192-5540-beaf-6361d966fc21_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/92/73928da73745969342cf8ac13fbe47d4/pa/ET05908_2ce948899f2c046305ba0428a354ff7a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-12-11',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Chevrolet Captiva 2.0 Diesel D LT 4WD',
 'transmission': 'automatic',
 'trim': 'D LT 4WD',
 'year': 2008}
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET05908%27 HTTP/1.1" 200 None
2026-03-28 12:05:53 [auto1.it] INFO: Saving data for ET05908: {'created_time': 1774699553.271026, 'last_price_update_time': 1774699553.271035, 'auction_closing_time': 1774883037.0}
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ET05908') HTTP/1.1" 204 0
2026-03-28 12:05:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BW81707/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_4259e323bd1a77452e9323633d537969.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_f803b2720e0746c5d2e1dadcdb62c28d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_d37de9ec972d08c9a4b988d987467110.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CE47539> (referer: https://www.auto1.com/v1/car-details-view/CE47539/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MJ56294> (referer: https://www.auto1.com/v1/car-details-view/MJ56294/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/5b/235b7e2f4b8e4e0d718047316a1b4faf/pa/KT14926_6cfb9c0bf7e088d579194644dceb1db3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc4072d0>
2026-03-28 12:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f005e36-16d3-5521-82dc-2e1786c34f8b/0f005e36-16d3-5521-82dc-2e1786c34f8b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F9f%252Fbf9f3989c9a9f3e1d1be9d8f6ba100e0%252Fpa%252FET22397_4259e323bd1a77452e9323633d537969.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_4259e323bd1a77452e9323633d537969.jpg saved to cache
2026-03-28 12:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f005e36-16d3-5521-82dc-2e1786c34f8b
2026-03-28 12:05:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f005e36-16d3-5521-82dc-2e1786c34f8b, skipping ID generation
2026-03-28 12:05:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f005e36-16d3-5521-82dc-2e1786c34f8b with scrape type 1
2026-03-28 12:05:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f005e36-16d3-5521-82dc-2e1786c34f8b sending to next pipeline
2026-03-28 12:05:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0f005e36-16d3-5521-82dc-2e1786c34f8b, identifier: ET22397
2026-03-28 12:05:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0f005e36-16d3-5521-82dc-2e1786c34f8b with identifier: ET22397
2026-03-28 12:05:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0f005e36-16d3-5521-82dc-2e1786c34f8b with identifier: ET22397
2026-03-28 12:05:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0f005e36-16d3-5521-82dc-2e1786c34f8b with identifier: ET22397 to the API
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_4259e323bd1a77452e9323633d537969.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:18:43Z',
 'fuel_type': 'diesel',
 'id': '0f005e36-16d3-5521-82dc-2e1786c34f8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET22397',
 'listing': 'auction',
 'location': 'IT, Venezia',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 162211,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f005e36-16d3-5521-82dc-2e1786c34f8b/0f005e36-16d3-5521-82dc-2e1786c34f8b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_e55530dcbd3da55513954fb98fe50c9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f005e36-16d3-5521-82dc-2e1786c34f8b/0f005e36-16d3-5521-82dc-2e1786c34f8b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_2615b885b84ffbd59c52d3438f400920.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f005e36-16d3-5521-82dc-2e1786c34f8b/0f005e36-16d3-5521-82dc-2e1786c34f8b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2515543,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_2f12aac290764a932c408217a2d8ad00.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f005e36-16d3-5521-82dc-2e1786c34f8b/0f005e36-16d3-5521-82dc-2e1786c34f8b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_ecfa660b52ca810aa5cf70d7c1bfe623.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f005e36-16d3-5521-82dc-2e1786c34f8b/0f005e36-16d3-5521-82dc-2e1786c34f8b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2657141,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_4259e323bd1a77452e9323633d537969.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f005e36-16d3-5521-82dc-2e1786c34f8b/0f005e36-16d3-5521-82dc-2e1786c34f8b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2697510,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_a4c0c27d827afe18c5890114066de48a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f005e36-16d3-5521-82dc-2e1786c34f8b/0f005e36-16d3-5521-82dc-2e1786c34f8b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_f08c6be3580ae3fa32690e259a75a159.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f005e36-16d3-5521-82dc-2e1786c34f8b/0f005e36-16d3-5521-82dc-2e1786c34f8b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_12f5724cd24a6faa8e59baf2fa0a4278.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f005e36-16d3-5521-82dc-2e1786c34f8b/0f005e36-16d3-5521-82dc-2e1786c34f8b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_f43f5296d00689daf6149ca87d5c84de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f005e36-16d3-5521-82dc-2e1786c34f8b/0f005e36-16d3-5521-82dc-2e1786c34f8b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2868321,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/9f/bf9f3989c9a9f3e1d1be9d8f6ba100e0/pa/ET22397_e520b26b6789838c3a70583738350672.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-10-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 xDrive 18d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET22397%27 HTTP/1.1" 200 None
2026-03-28 12:05:53 [auto1.it] INFO: Saving data for ET22397: {'created_time': 1774699553.985768, 'last_price_update_time': 1774699553.985779, 'auction_closing_time': 1774883923.0}
2026-03-28 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ET22397') HTTP/1.1" 204 0
2026-03-28 12:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_08ad9f0fe4962df8e068c27cb8f3248c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_e6d70a682a47f14d067417ebde06dfbb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LN66513> (referer: https://www.auto1.com/v1/car-details-view/LN66513/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DP83591> (referer: https://www.auto1.com/v1/car-details-view/DP83591/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bce98a90>
2026-03-28 12:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bf022d-7d60-5a1a-80ee-3a1d403d3872/91bf022d-7d60-5a1a-80ee-3a1d403d3872_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fb1%252F86b13e7fe20b0ac0511511fa2d3aaa00%252Fpa%252FAY76833_f803b2720e0746c5d2e1dadcdb62c28d.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_f803b2720e0746c5d2e1dadcdb62c28d.jpg saved to cache
2026-03-28 12:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 91bf022d-7d60-5a1a-80ee-3a1d403d3872
2026-03-28 12:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc65c290>
2026-03-28 12:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bf022d-7d60-5a1a-80ee-3a1d403d3872/91bf022d-7d60-5a1a-80ee-3a1d403d3872_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fb1%252F86b13e7fe20b0ac0511511fa2d3aaa00%252Fpa%252FAY76833_d37de9ec972d08c9a4b988d987467110.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_d37de9ec972d08c9a4b988d987467110.jpg saved to cache
2026-03-28 12:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 91bf022d-7d60-5a1a-80ee-3a1d403d3872
2026-03-28 12:05:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 91bf022d-7d60-5a1a-80ee-3a1d403d3872, skipping ID generation
2026-03-28 12:05:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91bf022d-7d60-5a1a-80ee-3a1d403d3872 with scrape type 1
2026-03-28 12:05:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 91bf022d-7d60-5a1a-80ee-3a1d403d3872 sending to next pipeline
2026-03-28 12:05:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 91bf022d-7d60-5a1a-80ee-3a1d403d3872, identifier: AY76833
2026-03-28 12:05:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6997b28-256f-5be2-8aee-fa9e98aee5d0 with identifier: CE47539
2026-03-28 12:05:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6997b28-256f-5be2-8aee-fa9e98aee5d0 with scrape type 1
2026-03-28 12:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a6997b28-256f-5be2-8aee-fa9e98aee5d0
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb2%252Fd8b22aa72b648f588813415a2db8c709%252Fpa%252FCE47539_c97c477b6adea3a3accf6b866aaeae5e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_c97c477b6adea3a3accf6b866aaeae5e.jpg not downloaded yet
2026-03-28 12:05:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8ac6608-4456-5c52-9330-2be57d5ec0ad with identifier: MJ56294
2026-03-28 12:05:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8ac6608-4456-5c52-9330-2be57d5ec0ad with scrape type 1
2026-03-28 12:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d8ac6608-4456-5c52-9330-2be57d5ec0ad
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F4c%252Fbd4c010344003408b163c1990103cf98%252Fpa%252FMJ56294_f9939d6d8bb3d6f13ce038a4ecc13a51.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/4c/bd4c010344003408b163c1990103cf98/pa/MJ56294_f9939d6d8bb3d6f13ce038a4ecc13a51.jpg already downloaded
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F4c%252Fbd4c010344003408b163c1990103cf98%252Fpa%252FMJ56294_3fcac01198588c880d4524106c580342.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/4c/bd4c010344003408b163c1990103cf98/pa/MJ56294_3fcac01198588c880d4524106c580342.jpg already downloaded
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F4c%252Fbd4c010344003408b163c1990103cf98%252Fpa%252FMJ56294_0694c300604db1beebffc66a63acb5b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/4c/bd4c010344003408b163c1990103cf98/pa/MJ56294_0694c300604db1beebffc66a63acb5b1.jpg already downloaded
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F4c%252Fbd4c010344003408b163c1990103cf98%252Fpa%252FMJ56294_307f6c9e505ce5bf59420339be41b453.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/4c/bd4c010344003408b163c1990103cf98/pa/MJ56294_307f6c9e505ce5bf59420339be41b453.jpg already downloaded
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F4c%252Fbd4c010344003408b163c1990103cf98%252Fpa%252FMJ56294_833f397b41f9adfd87dbf3c8e750f676.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/4c/bd4c010344003408b163c1990103cf98/pa/MJ56294_833f397b41f9adfd87dbf3c8e750f676.jpg already downloaded
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F4c%252Fbd4c010344003408b163c1990103cf98%252Fpa%252FMJ56294_4520552e87c5e98cbe253543f9d08c67.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/4c/bd4c010344003408b163c1990103cf98/pa/MJ56294_4520552e87c5e98cbe253543f9d08c67.jpg already downloaded
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F4c%252Fbd4c010344003408b163c1990103cf98%252Fpa%252FMJ56294_f1ff9a268fe5b172abcb5392c36e1433.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/4c/bd4c010344003408b163c1990103cf98/pa/MJ56294_f1ff9a268fe5b172abcb5392c36e1433.jpg already downloaded
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F4c%252Fbd4c010344003408b163c1990103cf98%252Fpa%252FMJ56294_6f41a20b600624f9228bc9be7f4f61c1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/4c/bd4c010344003408b163c1990103cf98/pa/MJ56294_6f41a20b600624f9228bc9be7f4f61c1.jpg already downloaded
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F4c%252Fbd4c010344003408b163c1990103cf98%252Fpa%252FMJ56294_79f5124997ba8f349d1c50c200702000.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/4c/bd4c010344003408b163c1990103cf98/pa/MJ56294_79f5124997ba8f349d1c50c200702000.jpg already downloaded
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F4c%252Fbd4c010344003408b163c1990103cf98%252Fpa%252FMJ56294_211e3d23b35379eaafa6e55ff97eb8d0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/4c/bd4c010344003408b163c1990103cf98/pa/MJ56294_211e3d23b35379eaafa6e55ff97eb8d0.jpg already downloaded
2026-03-28 12:05:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d8ac6608-4456-5c52-9330-2be57d5ec0ad, identifier: MJ56294
2026-03-28 12:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3aa750>
2026-03-28 12:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b51a8a2c-1974-5620-a637-684ee20c2e01/b51a8a2c-1974-5620-a637-684ee20c2e01_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F5b%252F235b7e2f4b8e4e0d718047316a1b4faf%252Fpa%252FKT14926_6cfb9c0bf7e088d579194644dceb1db3.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/5b/235b7e2f4b8e4e0d718047316a1b4faf/pa/KT14926_6cfb9c0bf7e088d579194644dceb1db3.jpg saved to cache
2026-03-28 12:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b51a8a2c-1974-5620-a637-684ee20c2e01
2026-03-28 12:05:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b51a8a2c-1974-5620-a637-684ee20c2e01, skipping ID generation
2026-03-28 12:05:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b51a8a2c-1974-5620-a637-684ee20c2e01 with scrape type 1
2026-03-28 12:05:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b51a8a2c-1974-5620-a637-684ee20c2e01 sending to next pipeline
2026-03-28 12:05:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b51a8a2c-1974-5620-a637-684ee20c2e01, identifier: KT14926
2026-03-28 12:05:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 91bf022d-7d60-5a1a-80ee-3a1d403d3872 with identifier: AY76833
2026-03-28 12:05:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 91bf022d-7d60-5a1a-80ee-3a1d403d3872 with identifier: AY76833
2026-03-28 12:05:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 91bf022d-7d60-5a1a-80ee-3a1d403d3872 with identifier: AY76833 to the API
2026-03-28 12:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_d37de9ec972d08c9a4b988d987467110.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:17:21Z',
 'fuel_type': 'diesel',
 'id': '91bf022d-7d60-5a1a-80ee-3a1d403d3872',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY76833',
 'listing': 'auction',
 'location': 'IT, Bergamo',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 142409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bf022d-7d60-5a1a-80ee-3a1d403d3872/91bf022d-7d60-5a1a-80ee-3a1d403d3872_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2139187,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_f803b2720e0746c5d2e1dadcdb62c28d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bf022d-7d60-5a1a-80ee-3a1d403d3872/91bf022d-7d60-5a1a-80ee-3a1d403d3872_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2282280,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_d37de9ec972d08c9a4b988d987467110.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bf022d-7d60-5a1a-80ee-3a1d403d3872/91bf022d-7d60-5a1a-80ee-3a1d403d3872_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2100821,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_a10647a8f3a1f9f7b37909754dbe4c35.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bf022d-7d60-5a1a-80ee-3a1d403d3872/91bf022d-7d60-5a1a-80ee-3a1d403d3872_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2129874,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_85fc811e8875445706d36cf041267d25.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bf022d-7d60-5a1a-80ee-3a1d403d3872/91bf022d-7d60-5a1a-80ee-3a1d403d3872_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1965761,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_999b5af6c33ae821ccf4d9a02d7a4151.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bf022d-7d60-5a1a-80ee-3a1d403d3872/91bf022d-7d60-5a1a-80ee-3a1d403d3872_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2290108,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_ef4100e1e8490c811bb2ea3e6f4c6b0e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bf022d-7d60-5a1a-80ee-3a1d403d3872/91bf022d-7d60-5a1a-80ee-3a1d403d3872_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2133635,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_65189e563217790d6fe88fc55abef02d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bf022d-7d60-5a1a-80ee-3a1d403d3872/91bf022d-7d60-5a1a-80ee-3a1d403d3872_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2038575,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_0432e033078c3743028eb3bce796f4dc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bf022d-7d60-5a1a-80ee-3a1d403d3872/91bf022d-7d60-5a1a-80ee-3a1d403d3872_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1936388,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_1fef0c31893c95b81bae3dbc7d37b80d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bf022d-7d60-5a1a-80ee-3a1d403d3872/91bf022d-7d60-5a1a-80ee-3a1d403d3872_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2380362,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img86/b1/86b13e7fe20b0ac0511511fa2d3aaa00/pa/AY76833_638e549b639ef7fd8c325f4a51328aae.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Executive 4x4',
 'transmission': 'automatic',
 'trim': 'Executive 4x4',
 'year': 2019}
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY76833%27 HTTP/1.1" 200 None
2026-03-28 12:05:55 [auto1.it] INFO: Saving data for AY76833: {'created_time': 1774699555.232959, 'last_price_update_time': 1774699555.232968, 'auction_closing_time': 1774883841.0}
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AY76833') HTTP/1.1" 204 0
2026-03-28 12:05:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d8ac6608-4456-5c52-9330-2be57d5ec0ad with identifier: MJ56294
2026-03-28 12:05:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d8ac6608-4456-5c52-9330-2be57d5ec0ad with identifier: MJ56294
2026-03-28 12:05:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d8ac6608-4456-5c52-9330-2be57d5ec0ad with identifier: MJ56294 to the API
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MJ56294>
{'auction_title': '',
 'c_o_2_emission_value': 192,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:20:13Z',
 'fuel_type': 'petrol',
 'id': 'd8ac6608-4456-5c52-9330-2be57d5ec0ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ56294',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 123392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgbd/4c/bd4c010344003408b163c1990103cf98/pa/MJ56294_f9939d6d8bb3d6f13ce038a4ecc13a51.jpg',
                'https://img-pa.auto1.com/imgbd/4c/bd4c010344003408b163c1990103cf98/pa/MJ56294_3fcac01198588c880d4524106c580342.jpg',
                'https://img-pa.auto1.com/imgbd/4c/bd4c010344003408b163c1990103cf98/pa/MJ56294_0694c300604db1beebffc66a63acb5b1.jpg',
                'https://img-pa.auto1.com/imgbd/4c/bd4c010344003408b163c1990103cf98/pa/MJ56294_307f6c9e505ce5bf59420339be41b453.jpg',
                'https://img-pa.auto1.com/imgbd/4c/bd4c010344003408b163c1990103cf98/pa/MJ56294_833f397b41f9adfd87dbf3c8e750f676.jpg',
                'https://img-pa.auto1.com/imgbd/4c/bd4c010344003408b163c1990103cf98/pa/MJ56294_4520552e87c5e98cbe253543f9d08c67.jpg',
                'https://img-pa.auto1.com/imgbd/4c/bd4c010344003408b163c1990103cf98/pa/MJ56294_f1ff9a268fe5b172abcb5392c36e1433.jpg',
                'https://img-pa.auto1.com/imgbd/4c/bd4c010344003408b163c1990103cf98/pa/MJ56294_6f41a20b600624f9228bc9be7f4f61c1.jpg',
                'https://img-pa.auto1.com/imgbd/4c/bd4c010344003408b163c1990103cf98/pa/MJ56294_79f5124997ba8f349d1c50c200702000.jpg',
                'https://img-pa.auto1.com/imgbd/4c/bd4c010344003408b163c1990103cf98/pa/MJ56294_211e3d23b35379eaafa6e55ff97eb8d0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8ac6608-4456-5c52-9330-2be57d5ec0ad/d8ac6608-4456-5c52-9330-2be57d5ec0ad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2860393,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/4c/bd4c010344003408b163c1990103cf98/pa/MJ56294_f9939d6d8bb3d6f13ce038a4ecc13a51.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8ac6608-4456-5c52-9330-2be57d5ec0ad/d8ac6608-4456-5c52-9330-2be57d5ec0ad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2715230,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/4c/bd4c010344003408b163c1990103cf98/pa/MJ56294_3fcac01198588c880d4524106c580342.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8ac6608-4456-5c52-9330-2be57d5ec0ad/d8ac6608-4456-5c52-9330-2be57d5ec0ad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2815072,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/4c/bd4c010344003408b163c1990103cf98/pa/MJ56294_0694c300604db1beebffc66a63acb5b1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8ac6608-4456-5c52-9330-2be57d5ec0ad/d8ac6608-4456-5c52-9330-2be57d5ec0ad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2378245,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/4c/bd4c010344003408b163c1990103cf98/pa/MJ56294_307f6c9e505ce5bf59420339be41b453.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8ac6608-4456-5c52-9330-2be57d5ec0ad/d8ac6608-4456-5c52-9330-2be57d5ec0ad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2464913,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/4c/bd4c010344003408b163c1990103cf98/pa/MJ56294_833f397b41f9adfd87dbf3c8e750f676.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8ac6608-4456-5c52-9330-2be57d5ec0ad/d8ac6608-4456-5c52-9330-2be57d5ec0ad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2732992,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/4c/bd4c010344003408b163c1990103cf98/pa/MJ56294_4520552e87c5e98cbe253543f9d08c67.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8ac6608-4456-5c52-9330-2be57d5ec0ad/d8ac6608-4456-5c52-9330-2be57d5ec0ad_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2344881,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/4c/bd4c010344003408b163c1990103cf98/pa/MJ56294_f1ff9a268fe5b172abcb5392c36e1433.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8ac6608-4456-5c52-9330-2be57d5ec0ad/d8ac6608-4456-5c52-9330-2be57d5ec0ad_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2758671,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/4c/bd4c010344003408b163c1990103cf98/pa/MJ56294_6f41a20b600624f9228bc9be7f4f61c1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8ac6608-4456-5c52-9330-2be57d5ec0ad/d8ac6608-4456-5c52-9330-2be57d5ec0ad_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2577159,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/4c/bd4c010344003408b163c1990103cf98/pa/MJ56294_79f5124997ba8f349d1c50c200702000.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8ac6608-4456-5c52-9330-2be57d5ec0ad/d8ac6608-4456-5c52-9330-2be57d5ec0ad_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2518465,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/4c/bd4c010344003408b163c1990103cf98/pa/MJ56294_211e3d23b35379eaafa6e55ff97eb8d0.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda CR-V 2.0 VTEC Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2008}
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ56294%27 HTTP/1.1" 200 None
2026-03-28 12:05:55 [auto1.it] INFO: Saving data for MJ56294: {'created_time': 1774699555.574814, 'last_price_update_time': 1774699555.574825, 'auction_closing_time': 1774884013.0}
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MJ56294') HTTP/1.1" 204 0
2026-03-28 12:05:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b51a8a2c-1974-5620-a637-684ee20c2e01 with identifier: KT14926
2026-03-28 12:05:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b51a8a2c-1974-5620-a637-684ee20c2e01 with identifier: KT14926
2026-03-28 12:05:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b51a8a2c-1974-5620-a637-684ee20c2e01 with identifier: KT14926 to the API
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img23/5b/235b7e2f4b8e4e0d718047316a1b4faf/pa/KT14926_6cfb9c0bf7e088d579194644dceb1db3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:32:13Z',
 'fuel_type': 'diesel',
 'id': 'b51a8a2c-1974-5620-a637-684ee20c2e01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT14926',
 'listing': 'auction',
 'location': 'IT, Desio (MB)',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 122611,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b51a8a2c-1974-5620-a637-684ee20c2e01/b51a8a2c-1974-5620-a637-684ee20c2e01_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/5b/235b7e2f4b8e4e0d718047316a1b4faf/pa/KT14926_6b73083fb533e032e877b78e3668c317.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b51a8a2c-1974-5620-a637-684ee20c2e01/b51a8a2c-1974-5620-a637-684ee20c2e01_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/5b/235b7e2f4b8e4e0d718047316a1b4faf/pa/KT14926_25db6fa1a5624d9446c782041b730578.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b51a8a2c-1974-5620-a637-684ee20c2e01/b51a8a2c-1974-5620-a637-684ee20c2e01_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102120,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/5b/235b7e2f4b8e4e0d718047316a1b4faf/pa/KT14926_41d913f98c56c73276fd9e72e8135410.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b51a8a2c-1974-5620-a637-684ee20c2e01/b51a8a2c-1974-5620-a637-684ee20c2e01_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/5b/235b7e2f4b8e4e0d718047316a1b4faf/pa/KT14926_ac9b09844c5b0beb3559e7b0124820ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b51a8a2c-1974-5620-a637-684ee20c2e01/b51a8a2c-1974-5620-a637-684ee20c2e01_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107877,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/5b/235b7e2f4b8e4e0d718047316a1b4faf/pa/KT14926_6cfb9c0bf7e088d579194644dceb1db3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-04-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.8 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2004}
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT14926%27 HTTP/1.1" 200 None
2026-03-28 12:05:55 [auto1.it] INFO: Saving data for KT14926: {'created_time': 1774699555.942708, 'last_price_update_time': 1774699555.942721, 'auction_closing_time': 1774884733.0}
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KT14926') HTTP/1.1" 204 0
2026-03-28 12:05:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb2%252Fd8b22aa72b648f588813415a2db8c709%252Fpa%252FCE47539_7f1ff564db11bd7d52f8202eeff8e64e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_7f1ff564db11bd7d52f8202eeff8e64e.jpg not downloaded yet
2026-03-28 12:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZK25339/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PW96424/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JZ77925/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PW47751/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb2%252Fd8b22aa72b648f588813415a2db8c709%252Fpa%252FCE47539_d8aa294b92f8d6d68b59421d9a89fa88.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_d8aa294b92f8d6d68b59421d9a89fa88.jpg not downloaded yet
2026-03-28 12:05:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3db3d0>
2026-03-28 12:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_162bacd6-cf45-5c7b-b8fb-2349c890dad3/162bacd6-cf45-5c7b-b8fb-2349c890dad3_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Ff4%252F69f426301771797af1096b611f3f27b5%252Fpa%252FZH08694_08ad9f0fe4962df8e068c27cb8f3248c.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_08ad9f0fe4962df8e068c27cb8f3248c.jpg saved to cache
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 162bacd6-cf45-5c7b-b8fb-2349c890dad3
2026-03-28 12:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3c7810>
2026-03-28 12:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_162bacd6-cf45-5c7b-b8fb-2349c890dad3/162bacd6-cf45-5c7b-b8fb-2349c890dad3_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Ff4%252F69f426301771797af1096b611f3f27b5%252Fpa%252FZH08694_e6d70a682a47f14d067417ebde06dfbb.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_e6d70a682a47f14d067417ebde06dfbb.jpg saved to cache
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 162bacd6-cf45-5c7b-b8fb-2349c890dad3
2026-03-28 12:05:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b157ce1c-c9d1-555e-9b81-8a5e18c654e9 with identifier: LN66513
2026-03-28 12:05:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b157ce1c-c9d1-555e-9b81-8a5e18c654e9 with scrape type 1
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b157ce1c-c9d1-555e-9b81-8a5e18c654e9
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F33%252F5633bdfc06003419a52a432aa281149b%252Fpa%252FLN66513_e531035bcee05f01dfae4ef4a294481a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_e531035bcee05f01dfae4ef4a294481a.jpg not downloaded yet
2026-03-28 12:05:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aac817f7-1eea-52ef-b4b4-fbc55a13ff13 with identifier: DP83591
2026-03-28 12:05:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aac817f7-1eea-52ef-b4b4-fbc55a13ff13 with scrape type 1
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aac817f7-1eea-52ef-b4b4-fbc55a13ff13
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fe2%252F3de26a10d154e74c844bddd192bb47ea%252Fpa%252FDP83591_10663238e04f060d7b1950509f3bf19e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_10663238e04f060d7b1950509f3bf19e.jpg not downloaded yet
2026-03-28 12:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_bec26742175c8efa21b32ea532de3e6f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb2%252Fd8b22aa72b648f588813415a2db8c709%252Fpa%252FCE47539_82748b92187dc6cc617b427ba597badd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_82748b92187dc6cc617b427ba597badd.jpg not downloaded yet
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F33%252F5633bdfc06003419a52a432aa281149b%252Fpa%252FLN66513_c61073384b40f45a6e74e231a7c9540b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_c61073384b40f45a6e74e231a7c9540b.jpg not downloaded yet
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fe2%252F3de26a10d154e74c844bddd192bb47ea%252Fpa%252FDP83591_e722776fdaf231a6e5342a0e3657a3dd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_e722776fdaf231a6e5342a0e3657a3dd.jpg not downloaded yet
2026-03-28 12:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_2a7d55d1a1819f43bcb189cba23cc008.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_ab49e9ecfd1762f502fbf4863cce5f61.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb2%252Fd8b22aa72b648f588813415a2db8c709%252Fpa%252FCE47539_f0a71c2dd84490fcf49bc23d949a8880.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_f0a71c2dd84490fcf49bc23d949a8880.jpg not downloaded yet
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F33%252F5633bdfc06003419a52a432aa281149b%252Fpa%252FLN66513_4d66a21cd2565bec403e6c71e93e47cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_4d66a21cd2565bec403e6c71e93e47cb.jpg not downloaded yet
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fe2%252F3de26a10d154e74c844bddd192bb47ea%252Fpa%252FDP83591_06cf020020a9d09f6d2ffadff4163fce.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_06cf020020a9d09f6d2ffadff4163fce.jpg not downloaded yet
2026-03-28 12:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_6422c60a83d229c9b64bebe653687334.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb2%252Fd8b22aa72b648f588813415a2db8c709%252Fpa%252FCE47539_9c4b463515498537fd88a1209c2b2b8b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_9c4b463515498537fd88a1209c2b2b8b.jpg not downloaded yet
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F33%252F5633bdfc06003419a52a432aa281149b%252Fpa%252FLN66513_bcb8fd8e45ebd38f2c012b8989da2e2e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_bcb8fd8e45ebd38f2c012b8989da2e2e.jpg not downloaded yet
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fe2%252F3de26a10d154e74c844bddd192bb47ea%252Fpa%252FDP83591_45966111bfec8d1eea4853e5f50e2eff.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_45966111bfec8d1eea4853e5f50e2eff.jpg not downloaded yet
2026-03-28 12:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_10663238e04f060d7b1950509f3bf19e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_2430d9ed86818c72fa9251bc336f9838.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb2%252Fd8b22aa72b648f588813415a2db8c709%252Fpa%252FCE47539_76c4a835c2909655460649c151300053.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_76c4a835c2909655460649c151300053.jpg not downloaded yet
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F33%252F5633bdfc06003419a52a432aa281149b%252Fpa%252FLN66513_dcb582b5f4a9f15d8ee656081edea095.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_dcb582b5f4a9f15d8ee656081edea095.jpg not downloaded yet
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fe2%252F3de26a10d154e74c844bddd192bb47ea%252Fpa%252FDP83591_9de22cda0dde6884344d4456c3dd4786.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_9de22cda0dde6884344d4456c3dd4786.jpg not downloaded yet
2026-03-28 12:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3b6910>
2026-03-28 12:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_162bacd6-cf45-5c7b-b8fb-2349c890dad3/162bacd6-cf45-5c7b-b8fb-2349c890dad3_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Ff4%252F69f426301771797af1096b611f3f27b5%252Fpa%252FZH08694_bec26742175c8efa21b32ea532de3e6f.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_bec26742175c8efa21b32ea532de3e6f.jpg saved to cache
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 162bacd6-cf45-5c7b-b8fb-2349c890dad3
2026-03-28 12:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_e531035bcee05f01dfae4ef4a294481a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb2%252Fd8b22aa72b648f588813415a2db8c709%252Fpa%252FCE47539_b21d79619fc6a50cb194400856a037a8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_b21d79619fc6a50cb194400856a037a8.jpg not downloaded yet
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F33%252F5633bdfc06003419a52a432aa281149b%252Fpa%252FLN66513_641bb5ff18c34c7310159e0e732ab097.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_641bb5ff18c34c7310159e0e732ab097.jpg not downloaded yet
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fe2%252F3de26a10d154e74c844bddd192bb47ea%252Fpa%252FDP83591_35b09938bdf45b826a4b2006d5cd3178.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_35b09938bdf45b826a4b2006d5cd3178.jpg not downloaded yet
2026-03-28 12:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3cdb10>
2026-03-28 12:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_515399f1-c951-5577-88f0-8b40f453c68e/515399f1-c951-5577-88f0-8b40f453c68e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd8%252Faed8d8d55f35b476d34c76ba49929d73%252Fpa%252FCS61296_2a7d55d1a1819f43bcb189cba23cc008.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_2a7d55d1a1819f43bcb189cba23cc008.jpg saved to cache
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 515399f1-c951-5577-88f0-8b40f453c68e
2026-03-28 12:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf37c50>
2026-03-28 12:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_162bacd6-cf45-5c7b-b8fb-2349c890dad3/162bacd6-cf45-5c7b-b8fb-2349c890dad3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Ff4%252F69f426301771797af1096b611f3f27b5%252Fpa%252FZH08694_ab49e9ecfd1762f502fbf4863cce5f61.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_ab49e9ecfd1762f502fbf4863cce5f61.jpg saved to cache
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 162bacd6-cf45-5c7b-b8fb-2349c890dad3
2026-03-28 12:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc62aa90>
2026-03-28 12:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_515399f1-c951-5577-88f0-8b40f453c68e/515399f1-c951-5577-88f0-8b40f453c68e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd8%252Faed8d8d55f35b476d34c76ba49929d73%252Fpa%252FCS61296_6422c60a83d229c9b64bebe653687334.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_6422c60a83d229c9b64bebe653687334.jpg saved to cache
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 515399f1-c951-5577-88f0-8b40f453c68e
2026-03-28 12:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_e722776fdaf231a6e5342a0e3657a3dd.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_06cf020020a9d09f6d2ffadff4163fce.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb2%252Fd8b22aa72b648f588813415a2db8c709%252Fpa%252FCE47539_cadea7fb2ea86dbcd3bcae482d5bfe5c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_cadea7fb2ea86dbcd3bcae482d5bfe5c.jpg not downloaded yet
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F33%252F5633bdfc06003419a52a432aa281149b%252Fpa%252FLN66513_f79d0954cc5f479a80fa9c19a74f1066.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_f79d0954cc5f479a80fa9c19a74f1066.jpg not downloaded yet
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fe2%252F3de26a10d154e74c844bddd192bb47ea%252Fpa%252FDP83591_da4bd491f7837a19eccc0dcd0a12196a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_da4bd491f7837a19eccc0dcd0a12196a.jpg not downloaded yet
2026-03-28 12:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WA05506/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04beed1490>
2026-03-28 12:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac817f7-1eea-52ef-b4b4-fbc55a13ff13/aac817f7-1eea-52ef-b4b4-fbc55a13ff13_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fe2%252F3de26a10d154e74c844bddd192bb47ea%252Fpa%252FDP83591_10663238e04f060d7b1950509f3bf19e.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_10663238e04f060d7b1950509f3bf19e.jpg saved to cache
2026-03-28 12:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aac817f7-1eea-52ef-b4b4-fbc55a13ff13
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc270cd0>
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_162bacd6-cf45-5c7b-b8fb-2349c890dad3/162bacd6-cf45-5c7b-b8fb-2349c890dad3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Ff4%252F69f426301771797af1096b611f3f27b5%252Fpa%252FZH08694_2430d9ed86818c72fa9251bc336f9838.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_2430d9ed86818c72fa9251bc336f9838.jpg saved to cache
2026-03-28 12:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 162bacd6-cf45-5c7b-b8fb-2349c890dad3
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfbfe90>
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b157ce1c-c9d1-555e-9b81-8a5e18c654e9/b157ce1c-c9d1-555e-9b81-8a5e18c654e9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F33%252F5633bdfc06003419a52a432aa281149b%252Fpa%252FLN66513_e531035bcee05f01dfae4ef4a294481a.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_e531035bcee05f01dfae4ef4a294481a.jpg saved to cache
2026-03-28 12:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b157ce1c-c9d1-555e-9b81-8a5e18c654e9
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb2%252Fd8b22aa72b648f588813415a2db8c709%252Fpa%252FCE47539_8da97c8bed71724edc100cc23bcf72b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_8da97c8bed71724edc100cc23bcf72b7.jpg not downloaded yet
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F33%252F5633bdfc06003419a52a432aa281149b%252Fpa%252FLN66513_fd69a751b0140230358fc68cf4ed5eee.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_fd69a751b0140230358fc68cf4ed5eee.jpg not downloaded yet
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fe2%252F3de26a10d154e74c844bddd192bb47ea%252Fpa%252FDP83591_6d662dafbd270050d30eace27c25fdf8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_6d662dafbd270050d30eace27c25fdf8.jpg not downloaded yet
2026-03-28 12:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_45966111bfec8d1eea4853e5f50e2eff.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_68ea54a5d65790be5b52083fb59d0253.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_bcb8fd8e45ebd38f2c012b8989da2e2e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F33%252F5633bdfc06003419a52a432aa281149b%252Fpa%252FLN66513_cca3bdc33ad6363f035a2c55df1ab456.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_cca3bdc33ad6363f035a2c55df1ab456.jpg not downloaded yet
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fe2%252F3de26a10d154e74c844bddd192bb47ea%252Fpa%252FDP83591_a27b38619e5dde67cfeb87ab586d9590.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_a27b38619e5dde67cfeb87ab586d9590.jpg not downloaded yet
2026-03-28 12:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BA01278/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VK68045/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfeac50>
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac817f7-1eea-52ef-b4b4-fbc55a13ff13/aac817f7-1eea-52ef-b4b4-fbc55a13ff13_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fe2%252F3de26a10d154e74c844bddd192bb47ea%252Fpa%252FDP83591_e722776fdaf231a6e5342a0e3657a3dd.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_e722776fdaf231a6e5342a0e3657a3dd.jpg saved to cache
2026-03-28 12:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aac817f7-1eea-52ef-b4b4-fbc55a13ff13
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc275150>
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac817f7-1eea-52ef-b4b4-fbc55a13ff13/aac817f7-1eea-52ef-b4b4-fbc55a13ff13_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fe2%252F3de26a10d154e74c844bddd192bb47ea%252Fpa%252FDP83591_06cf020020a9d09f6d2ffadff4163fce.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_06cf020020a9d09f6d2ffadff4163fce.jpg saved to cache
2026-03-28 12:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aac817f7-1eea-52ef-b4b4-fbc55a13ff13
2026-03-28 12:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_9de22cda0dde6884344d4456c3dd4786.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F33%252F5633bdfc06003419a52a432aa281149b%252Fpa%252FLN66513_1babb49b96e1fa4dfce31ee44465afc4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_1babb49b96e1fa4dfce31ee44465afc4.jpg not downloaded yet
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fe2%252F3de26a10d154e74c844bddd192bb47ea%252Fpa%252FDP83591_52fdcc31c36485aed6a8c133382c3217.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_52fdcc31c36485aed6a8c133382c3217.jpg not downloaded yet
2026-03-28 12:05:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BW81707> (referer: https://www.auto1.com/v1/car-details-view/BW81707/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TF83722/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VZ92626/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5ec590>
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac817f7-1eea-52ef-b4b4-fbc55a13ff13/aac817f7-1eea-52ef-b4b4-fbc55a13ff13_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fe2%252F3de26a10d154e74c844bddd192bb47ea%252Fpa%252FDP83591_45966111bfec8d1eea4853e5f50e2eff.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_45966111bfec8d1eea4853e5f50e2eff.jpg saved to cache
2026-03-28 12:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aac817f7-1eea-52ef-b4b4-fbc55a13ff13
2026-03-28 12:05:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf89250>
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_515399f1-c951-5577-88f0-8b40f453c68e/515399f1-c951-5577-88f0-8b40f453c68e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd8%252Faed8d8d55f35b476d34c76ba49929d73%252Fpa%252FCS61296_68ea54a5d65790be5b52083fb59d0253.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_68ea54a5d65790be5b52083fb59d0253.jpg saved to cache
2026-03-28 12:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 515399f1-c951-5577-88f0-8b40f453c68e
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bceb7c90>
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b157ce1c-c9d1-555e-9b81-8a5e18c654e9/b157ce1c-c9d1-555e-9b81-8a5e18c654e9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F33%252F5633bdfc06003419a52a432aa281149b%252Fpa%252FLN66513_bcb8fd8e45ebd38f2c012b8989da2e2e.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_bcb8fd8e45ebd38f2c012b8989da2e2e.jpg saved to cache
2026-03-28 12:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b157ce1c-c9d1-555e-9b81-8a5e18c654e9
2026-03-28 12:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_9e768f09ea978b8d8dda12fa3a100742.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_da4bd491f7837a19eccc0dcd0a12196a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_35b09938bdf45b826a4b2006d5cd3178.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_6d662dafbd270050d30eace27c25fdf8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5218d0>
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac817f7-1eea-52ef-b4b4-fbc55a13ff13/aac817f7-1eea-52ef-b4b4-fbc55a13ff13_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fe2%252F3de26a10d154e74c844bddd192bb47ea%252Fpa%252FDP83591_9de22cda0dde6884344d4456c3dd4786.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_9de22cda0dde6884344d4456c3dd4786.jpg saved to cache
2026-03-28 12:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aac817f7-1eea-52ef-b4b4-fbc55a13ff13
2026-03-28 12:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32a05e00-557e-56be-9199-01c5577554c4 with identifier: BW81707
2026-03-28 12:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32a05e00-557e-56be-9199-01c5577554c4 with scrape type 1
2026-03-28 12:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 32a05e00-557e-56be-9199-01c5577554c4
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fcd%252Fcbcd16ad7318fba2454ae3afbcadad92%252Fpa%252FBW81707_b6c8ea0f5e78080575c54f953833d57b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/cd/cbcd16ad7318fba2454ae3afbcadad92/pa/BW81707_b6c8ea0f5e78080575c54f953833d57b.jpg not downloaded yet
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fcd%252Fcbcd16ad7318fba2454ae3afbcadad92%252Fpa%252FBW81707_b69acec6b47dc2b065b7f22ae009bc69.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/cd/cbcd16ad7318fba2454ae3afbcadad92/pa/BW81707_b69acec6b47dc2b065b7f22ae009bc69.jpg not downloaded yet
2026-03-28 12:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_cca3bdc33ad6363f035a2c55df1ab456.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fcd%252Fcbcd16ad7318fba2454ae3afbcadad92%252Fpa%252FBW81707_db1ae55b266b93eb9c21d9b581e18d6f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/cd/cbcd16ad7318fba2454ae3afbcadad92/pa/BW81707_db1ae55b266b93eb9c21d9b581e18d6f.jpg not downloaded yet
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fcd%252Fcbcd16ad7318fba2454ae3afbcadad92%252Fpa%252FBW81707_8b5952b61d56f96dadfa2bc3b9f8abd0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/cd/cbcd16ad7318fba2454ae3afbcadad92/pa/BW81707_8b5952b61d56f96dadfa2bc3b9f8abd0.jpg not downloaded yet
2026-03-28 12:05:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bee85710>
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_515399f1-c951-5577-88f0-8b40f453c68e/515399f1-c951-5577-88f0-8b40f453c68e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd8%252Faed8d8d55f35b476d34c76ba49929d73%252Fpa%252FCS61296_9e768f09ea978b8d8dda12fa3a100742.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_9e768f09ea978b8d8dda12fa3a100742.jpg saved to cache
2026-03-28 12:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 515399f1-c951-5577-88f0-8b40f453c68e
2026-03-28 12:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bf1c0590>
2026-03-28 12:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac817f7-1eea-52ef-b4b4-fbc55a13ff13/aac817f7-1eea-52ef-b4b4-fbc55a13ff13_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fe2%252F3de26a10d154e74c844bddd192bb47ea%252Fpa%252FDP83591_da4bd491f7837a19eccc0dcd0a12196a.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_da4bd491f7837a19eccc0dcd0a12196a.jpg saved to cache
2026-03-28 12:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aac817f7-1eea-52ef-b4b4-fbc55a13ff13
2026-03-28 12:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfcbd90>
2026-03-28 12:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac817f7-1eea-52ef-b4b4-fbc55a13ff13/aac817f7-1eea-52ef-b4b4-fbc55a13ff13_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fe2%252F3de26a10d154e74c844bddd192bb47ea%252Fpa%252FDP83591_35b09938bdf45b826a4b2006d5cd3178.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_35b09938bdf45b826a4b2006d5cd3178.jpg saved to cache
2026-03-28 12:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aac817f7-1eea-52ef-b4b4-fbc55a13ff13
2026-03-28 12:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3eb6d0>
2026-03-28 12:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac817f7-1eea-52ef-b4b4-fbc55a13ff13/aac817f7-1eea-52ef-b4b4-fbc55a13ff13_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fe2%252F3de26a10d154e74c844bddd192bb47ea%252Fpa%252FDP83591_6d662dafbd270050d30eace27c25fdf8.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_6d662dafbd270050d30eace27c25fdf8.jpg saved to cache
2026-03-28 12:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aac817f7-1eea-52ef-b4b4-fbc55a13ff13
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fcd%252Fcbcd16ad7318fba2454ae3afbcadad92%252Fpa%252FBW81707_1ddf034e52bcec1eeab416ac45970c82.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/cd/cbcd16ad7318fba2454ae3afbcadad92/pa/BW81707_1ddf034e52bcec1eeab416ac45970c82.jpg not downloaded yet
2026-03-28 12:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_a27b38619e5dde67cfeb87ab586d9590.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_52fdcc31c36485aed6a8c133382c3217.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3b2f50>
2026-03-28 12:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b157ce1c-c9d1-555e-9b81-8a5e18c654e9/b157ce1c-c9d1-555e-9b81-8a5e18c654e9_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F33%252F5633bdfc06003419a52a432aa281149b%252Fpa%252FLN66513_cca3bdc33ad6363f035a2c55df1ab456.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_cca3bdc33ad6363f035a2c55df1ab456.jpg saved to cache
2026-03-28 12:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b157ce1c-c9d1-555e-9b81-8a5e18c654e9
2026-03-28 12:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_c97c477b6adea3a3accf6b866aaeae5e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_b03c3018e8321e40568d2e673d39d072.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_7f1ff564db11bd7d52f8202eeff8e64e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_1babb49b96e1fa4dfce31ee44465afc4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_641bb5ff18c34c7310159e0e732ab097.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_fd69a751b0140230358fc68cf4ed5eee.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_8da97c8bed71724edc100cc23bcf72b7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/cd/cbcd16ad7318fba2454ae3afbcadad92/pa/BW81707_db1ae55b266b93eb9c21d9b581e18d6f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/cd/cbcd16ad7318fba2454ae3afbcadad92/pa/BW81707_8b5952b61d56f96dadfa2bc3b9f8abd0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc596150>
2026-03-28 12:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac817f7-1eea-52ef-b4b4-fbc55a13ff13/aac817f7-1eea-52ef-b4b4-fbc55a13ff13_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fe2%252F3de26a10d154e74c844bddd192bb47ea%252Fpa%252FDP83591_a27b38619e5dde67cfeb87ab586d9590.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_a27b38619e5dde67cfeb87ab586d9590.jpg saved to cache
2026-03-28 12:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aac817f7-1eea-52ef-b4b4-fbc55a13ff13
2026-03-28 12:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd058690>
2026-03-28 12:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac817f7-1eea-52ef-b4b4-fbc55a13ff13/aac817f7-1eea-52ef-b4b4-fbc55a13ff13_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fe2%252F3de26a10d154e74c844bddd192bb47ea%252Fpa%252FDP83591_52fdcc31c36485aed6a8c133382c3217.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_52fdcc31c36485aed6a8c133382c3217.jpg saved to cache
2026-03-28 12:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aac817f7-1eea-52ef-b4b4-fbc55a13ff13
2026-03-28 12:05:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aac817f7-1eea-52ef-b4b4-fbc55a13ff13, skipping ID generation
2026-03-28 12:05:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aac817f7-1eea-52ef-b4b4-fbc55a13ff13 with scrape type 1
2026-03-28 12:05:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aac817f7-1eea-52ef-b4b4-fbc55a13ff13 sending to next pipeline
2026-03-28 12:05:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: aac817f7-1eea-52ef-b4b4-fbc55a13ff13, identifier: DP83591
2026-03-28 12:05:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: aac817f7-1eea-52ef-b4b4-fbc55a13ff13 with identifier: DP83591
2026-03-28 12:05:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: aac817f7-1eea-52ef-b4b4-fbc55a13ff13 with identifier: DP83591
2026-03-28 12:05:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: aac817f7-1eea-52ef-b4b4-fbc55a13ff13 with identifier: DP83591 to the API
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:05:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_52fdcc31c36485aed6a8c133382c3217.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:46:56Z',
 'fuel_type': 'diesel',
 'id': 'aac817f7-1eea-52ef-b4b4-fbc55a13ff13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP83591',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 67502,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac817f7-1eea-52ef-b4b4-fbc55a13ff13/aac817f7-1eea-52ef-b4b4-fbc55a13ff13_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57448,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_10663238e04f060d7b1950509f3bf19e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac817f7-1eea-52ef-b4b4-fbc55a13ff13/aac817f7-1eea-52ef-b4b4-fbc55a13ff13_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_e722776fdaf231a6e5342a0e3657a3dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac817f7-1eea-52ef-b4b4-fbc55a13ff13/aac817f7-1eea-52ef-b4b4-fbc55a13ff13_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61058,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_06cf020020a9d09f6d2ffadff4163fce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac817f7-1eea-52ef-b4b4-fbc55a13ff13/aac817f7-1eea-52ef-b4b4-fbc55a13ff13_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_45966111bfec8d1eea4853e5f50e2eff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac817f7-1eea-52ef-b4b4-fbc55a13ff13/aac817f7-1eea-52ef-b4b4-fbc55a13ff13_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_9de22cda0dde6884344d4456c3dd4786.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac817f7-1eea-52ef-b4b4-fbc55a13ff13/aac817f7-1eea-52ef-b4b4-fbc55a13ff13_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_35b09938bdf45b826a4b2006d5cd3178.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac817f7-1eea-52ef-b4b4-fbc55a13ff13/aac817f7-1eea-52ef-b4b4-fbc55a13ff13_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_da4bd491f7837a19eccc0dcd0a12196a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac817f7-1eea-52ef-b4b4-fbc55a13ff13/aac817f7-1eea-52ef-b4b4-fbc55a13ff13_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_6d662dafbd270050d30eace27c25fdf8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac817f7-1eea-52ef-b4b4-fbc55a13ff13/aac817f7-1eea-52ef-b4b4-fbc55a13ff13_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59542,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_a27b38619e5dde67cfeb87ab586d9590.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac817f7-1eea-52ef-b4b4-fbc55a13ff13/aac817f7-1eea-52ef-b4b4-fbc55a13ff13_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_52fdcc31c36485aed6a8c133382c3217.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque D165 Mild-Hybrid S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2021}
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP83591%27 HTTP/1.1" 200 None
2026-03-28 12:05:58 [auto1.it] INFO: Saving data for DP83591: {'created_time': 1774699558.963987, 'last_price_update_time': 1774699558.964, 'auction_closing_time': 1774885616.0}
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DP83591') HTTP/1.1" 204 0
2026-03-28 12:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/cd/cbcd16ad7318fba2454ae3afbcadad92/pa/BW81707_b69acec6b47dc2b065b7f22ae009bc69.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_f79d0954cc5f479a80fa9c19a74f1066.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_b21d79619fc6a50cb194400856a037a8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WA05506> (referer: https://www.auto1.com/v1/car-details-view/WA05506/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5978d0>
2026-03-28 12:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6997b28-256f-5be2-8aee-fa9e98aee5d0/a6997b28-256f-5be2-8aee-fa9e98aee5d0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb2%252Fd8b22aa72b648f588813415a2db8c709%252Fpa%252FCE47539_c97c477b6adea3a3accf6b866aaeae5e.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_c97c477b6adea3a3accf6b866aaeae5e.jpg saved to cache
2026-03-28 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a6997b28-256f-5be2-8aee-fa9e98aee5d0
2026-03-28 12:05:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcebc290>
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_515399f1-c951-5577-88f0-8b40f453c68e/515399f1-c951-5577-88f0-8b40f453c68e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd8%252Faed8d8d55f35b476d34c76ba49929d73%252Fpa%252FCS61296_b03c3018e8321e40568d2e673d39d072.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_b03c3018e8321e40568d2e673d39d072.jpg saved to cache
2026-03-28 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 515399f1-c951-5577-88f0-8b40f453c68e
2026-03-28 12:05:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfd4310>
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6997b28-256f-5be2-8aee-fa9e98aee5d0/a6997b28-256f-5be2-8aee-fa9e98aee5d0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb2%252Fd8b22aa72b648f588813415a2db8c709%252Fpa%252FCE47539_7f1ff564db11bd7d52f8202eeff8e64e.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_7f1ff564db11bd7d52f8202eeff8e64e.jpg saved to cache
2026-03-28 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a6997b28-256f-5be2-8aee-fa9e98aee5d0
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcebfc10>
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b157ce1c-c9d1-555e-9b81-8a5e18c654e9/b157ce1c-c9d1-555e-9b81-8a5e18c654e9_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F33%252F5633bdfc06003419a52a432aa281149b%252Fpa%252FLN66513_1babb49b96e1fa4dfce31ee44465afc4.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_1babb49b96e1fa4dfce31ee44465afc4.jpg saved to cache
2026-03-28 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b157ce1c-c9d1-555e-9b81-8a5e18c654e9
2026-03-28 12:05:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5d5550>
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b157ce1c-c9d1-555e-9b81-8a5e18c654e9/b157ce1c-c9d1-555e-9b81-8a5e18c654e9_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F33%252F5633bdfc06003419a52a432aa281149b%252Fpa%252FLN66513_641bb5ff18c34c7310159e0e732ab097.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_641bb5ff18c34c7310159e0e732ab097.jpg saved to cache
2026-03-28 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b157ce1c-c9d1-555e-9b81-8a5e18c654e9
2026-03-28 12:05:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5bd910>
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b157ce1c-c9d1-555e-9b81-8a5e18c654e9/b157ce1c-c9d1-555e-9b81-8a5e18c654e9_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F33%252F5633bdfc06003419a52a432aa281149b%252Fpa%252FLN66513_fd69a751b0140230358fc68cf4ed5eee.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_fd69a751b0140230358fc68cf4ed5eee.jpg saved to cache
2026-03-28 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b157ce1c-c9d1-555e-9b81-8a5e18c654e9
2026-03-28 12:05:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfd5f90>
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6997b28-256f-5be2-8aee-fa9e98aee5d0/a6997b28-256f-5be2-8aee-fa9e98aee5d0_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb2%252Fd8b22aa72b648f588813415a2db8c709%252Fpa%252FCE47539_8da97c8bed71724edc100cc23bcf72b7.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_8da97c8bed71724edc100cc23bcf72b7.jpg saved to cache
2026-03-28 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a6997b28-256f-5be2-8aee-fa9e98aee5d0
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5bf8d0>
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32a05e00-557e-56be-9199-01c5577554c4/32a05e00-557e-56be-9199-01c5577554c4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fcd%252Fcbcd16ad7318fba2454ae3afbcadad92%252Fpa%252FBW81707_db1ae55b266b93eb9c21d9b581e18d6f.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/cd/cbcd16ad7318fba2454ae3afbcadad92/pa/BW81707_db1ae55b266b93eb9c21d9b581e18d6f.jpg saved to cache
2026-03-28 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 32a05e00-557e-56be-9199-01c5577554c4
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcebf350>
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32a05e00-557e-56be-9199-01c5577554c4/32a05e00-557e-56be-9199-01c5577554c4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fcd%252Fcbcd16ad7318fba2454ae3afbcadad92%252Fpa%252FBW81707_8b5952b61d56f96dadfa2bc3b9f8abd0.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/cd/cbcd16ad7318fba2454ae3afbcadad92/pa/BW81707_8b5952b61d56f96dadfa2bc3b9f8abd0.jpg saved to cache
2026-03-28 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 32a05e00-557e-56be-9199-01c5577554c4
2026-03-28 12:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VK68045> (referer: https://www.auto1.com/v1/car-details-view/VK68045/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BA01278> (referer: https://www.auto1.com/v1/car-details-view/BA01278/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfd4890>
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32a05e00-557e-56be-9199-01c5577554c4/32a05e00-557e-56be-9199-01c5577554c4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fcd%252Fcbcd16ad7318fba2454ae3afbcadad92%252Fpa%252FBW81707_b69acec6b47dc2b065b7f22ae009bc69.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/cd/cbcd16ad7318fba2454ae3afbcadad92/pa/BW81707_b69acec6b47dc2b065b7f22ae009bc69.jpg saved to cache
2026-03-28 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 32a05e00-557e-56be-9199-01c5577554c4
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc590c50>
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b157ce1c-c9d1-555e-9b81-8a5e18c654e9/b157ce1c-c9d1-555e-9b81-8a5e18c654e9_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F33%252F5633bdfc06003419a52a432aa281149b%252Fpa%252FLN66513_f79d0954cc5f479a80fa9c19a74f1066.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_f79d0954cc5f479a80fa9c19a74f1066.jpg saved to cache
2026-03-28 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b157ce1c-c9d1-555e-9b81-8a5e18c654e9
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc612e10>
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6997b28-256f-5be2-8aee-fa9e98aee5d0/a6997b28-256f-5be2-8aee-fa9e98aee5d0_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb2%252Fd8b22aa72b648f588813415a2db8c709%252Fpa%252FCE47539_b21d79619fc6a50cb194400856a037a8.jpg') HTTP/1.1" 204 0
2026-03-28 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_b21d79619fc6a50cb194400856a037a8.jpg saved to cache
2026-03-28 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a6997b28-256f-5be2-8aee-fa9e98aee5d0
2026-03-28 12:05:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d9c297f-ad9d-5faf-b514-c63740f12274 with identifier: WA05506
2026-03-28 12:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d9c297f-ad9d-5faf-b514-c63740f12274 with scrape type 1
2026-03-28 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 0d9c297f-ad9d-5faf-b514-c63740f12274
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F7c%252Fdd7c761b1f331ce08fb2bd0a4206ace4%252Fpa%252FWA05506_0e9586516a5b94ffc889ccc8a9c4473e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_0e9586516a5b94ffc889ccc8a9c4473e.jpg not downloaded yet
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F7c%252Fdd7c761b1f331ce08fb2bd0a4206ace4%252Fpa%252FWA05506_f47652049c8d37cf37977d1a9ec0bb25.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_f47652049c8d37cf37977d1a9ec0bb25.jpg not downloaded yet
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F7c%252Fdd7c761b1f331ce08fb2bd0a4206ace4%252Fpa%252FWA05506_fa941e6bda5226faae6600b8ee0dd592.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_fa941e6bda5226faae6600b8ee0dd592.jpg not downloaded yet
2026-03-28 12:05:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 804a424d-3bfa-54e1-bf0b-df648ed2354b with identifier: VK68045
2026-03-28 12:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 804a424d-3bfa-54e1-bf0b-df648ed2354b with scrape type 1
2026-03-28 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 804a424d-3bfa-54e1-bf0b-df648ed2354b
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F30%252Fc530460c0a81b90317d9786974d7cc2d%252Fpa%252FVK68045_fc0a9bbc704ad1e892d5cfde2b583e3e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/30/c530460c0a81b90317d9786974d7cc2d/pa/VK68045_fc0a9bbc704ad1e892d5cfde2b583e3e.jpg not downloaded yet
2026-03-28 12:05:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdb652e9-c41c-5be4-b3fb-00beff0f6480 with identifier: BA01278
2026-03-28 12:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdb652e9-c41c-5be4-b3fb-00beff0f6480 with scrape type 1
2026-03-28 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bdb652e9-c41c-5be4-b3fb-00beff0f6480
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ffa%252F9cfacb2691ab5d058276a609b31b57fc%252Fpa%252FBA01278_107bd98e04f0cef9fb18fb9bbb496045.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_107bd98e04f0cef9fb18fb9bbb496045.jpg not downloaded yet
2026-03-28 12:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_4d66a21cd2565bec403e6c71e93e47cb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F7c%252Fdd7c761b1f331ce08fb2bd0a4206ace4%252Fpa%252FWA05506_28a5ebbd5f6f47c8bb5fa8d0b887c798.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_28a5ebbd5f6f47c8bb5fa8d0b887c798.jpg not downloaded yet
2026-03-28 12:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/cd/cbcd16ad7318fba2454ae3afbcadad92/pa/BW81707_b6c8ea0f5e78080575c54f953833d57b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/cd/cbcd16ad7318fba2454ae3afbcadad92/pa/BW81707_1ddf034e52bcec1eeab416ac45970c82.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F30%252Fc530460c0a81b90317d9786974d7cc2d%252Fpa%252FVK68045_d25f03619753519925ed0c17920c13cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/30/c530460c0a81b90317d9786974d7cc2d/pa/VK68045_d25f03619753519925ed0c17920c13cf.jpg not downloaded yet
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ffa%252F9cfacb2691ab5d058276a609b31b57fc%252Fpa%252FBA01278_94fa9cdf89bd6d88379e448239c0d310.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_94fa9cdf89bd6d88379e448239c0d310.jpg not downloaded yet
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F7c%252Fdd7c761b1f331ce08fb2bd0a4206ace4%252Fpa%252FWA05506_e803b5b959e84cc2d317653a0a5a1a97.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_e803b5b959e84cc2d317653a0a5a1a97.jpg not downloaded yet
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F30%252Fc530460c0a81b90317d9786974d7cc2d%252Fpa%252FVK68045_e8099a1c696fe623a3912f8feb303ab6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/30/c530460c0a81b90317d9786974d7cc2d/pa/VK68045_e8099a1c696fe623a3912f8feb303ab6.jpg not downloaded yet
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ffa%252F9cfacb2691ab5d058276a609b31b57fc%252Fpa%252FBA01278_604cb0b3427e121e88f4ddb1b63b04f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_604cb0b3427e121e88f4ddb1b63b04f2.jpg not downloaded yet
2026-03-28 12:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_f0a71c2dd84490fcf49bc23d949a8880.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_c61073384b40f45a6e74e231a7c9540b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F30%252Fc530460c0a81b90317d9786974d7cc2d%252Fpa%252FVK68045_dd38b2235453bde180f625c8a011b47d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/30/c530460c0a81b90317d9786974d7cc2d/pa/VK68045_dd38b2235453bde180f625c8a011b47d.jpg not downloaded yet
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ffa%252F9cfacb2691ab5d058276a609b31b57fc%252Fpa%252FBA01278_d0d1c5b858b8897c4c9279fed3993acd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_d0d1c5b858b8897c4c9279fed3993acd.jpg not downloaded yet
2026-03-28 12:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_107bd98e04f0cef9fb18fb9bbb496045.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc590610>
2026-03-28 12:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b157ce1c-c9d1-555e-9b81-8a5e18c654e9/b157ce1c-c9d1-555e-9b81-8a5e18c654e9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F33%252F5633bdfc06003419a52a432aa281149b%252Fpa%252FLN66513_4d66a21cd2565bec403e6c71e93e47cb.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_4d66a21cd2565bec403e6c71e93e47cb.jpg saved to cache
2026-03-28 12:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b157ce1c-c9d1-555e-9b81-8a5e18c654e9
2026-03-28 12:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd026c10>
2026-03-28 12:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32a05e00-557e-56be-9199-01c5577554c4/32a05e00-557e-56be-9199-01c5577554c4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fcd%252Fcbcd16ad7318fba2454ae3afbcadad92%252Fpa%252FBW81707_b6c8ea0f5e78080575c54f953833d57b.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/cd/cbcd16ad7318fba2454ae3afbcadad92/pa/BW81707_b6c8ea0f5e78080575c54f953833d57b.jpg saved to cache
2026-03-28 12:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 32a05e00-557e-56be-9199-01c5577554c4
2026-03-28 12:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3dd350>
2026-03-28 12:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32a05e00-557e-56be-9199-01c5577554c4/32a05e00-557e-56be-9199-01c5577554c4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fcd%252Fcbcd16ad7318fba2454ae3afbcadad92%252Fpa%252FBW81707_1ddf034e52bcec1eeab416ac45970c82.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/cd/cbcd16ad7318fba2454ae3afbcadad92/pa/BW81707_1ddf034e52bcec1eeab416ac45970c82.jpg saved to cache
2026-03-28 12:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 32a05e00-557e-56be-9199-01c5577554c4
2026-03-28 12:06:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 32a05e00-557e-56be-9199-01c5577554c4, skipping ID generation
2026-03-28 12:06:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32a05e00-557e-56be-9199-01c5577554c4 with scrape type 1
2026-03-28 12:06:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 32a05e00-557e-56be-9199-01c5577554c4 sending to next pipeline
2026-03-28 12:06:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 32a05e00-557e-56be-9199-01c5577554c4, identifier: BW81707
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F30%252Fc530460c0a81b90317d9786974d7cc2d%252Fpa%252FVK68045_92cc1d995bec1463f2f0e56b6803ae65.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/30/c530460c0a81b90317d9786974d7cc2d/pa/VK68045_92cc1d995bec1463f2f0e56b6803ae65.jpg not downloaded yet
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ffa%252F9cfacb2691ab5d058276a609b31b57fc%252Fpa%252FBA01278_8589214ceb3fd895cf6a5321af4a8bf2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_8589214ceb3fd895cf6a5321af4a8bf2.jpg not downloaded yet
2026-03-28 12:06:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 32a05e00-557e-56be-9199-01c5577554c4 with identifier: BW81707
2026-03-28 12:06:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 32a05e00-557e-56be-9199-01c5577554c4 with identifier: BW81707
2026-03-28 12:06:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 32a05e00-557e-56be-9199-01c5577554c4 with identifier: BW81707 to the API
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcb/cd/cbcd16ad7318fba2454ae3afbcadad92/pa/BW81707_1ddf034e52bcec1eeab416ac45970c82.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 202,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '1.7L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:32:06Z',
 'fuel_type': 'petrol',
 'id': '32a05e00-557e-56be-9199-01c5577554c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW81707',
 'listing': 'auction',
 'location': 'IT, Tradein',
 'make': 'Alfa Romeo',
 'model': 'Alfa GT',
 'odometer': 62236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a05e00-557e-56be-9199-01c5577554c4/32a05e00-557e-56be-9199-01c5577554c4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/cd/cbcd16ad7318fba2454ae3afbcadad92/pa/BW81707_b6c8ea0f5e78080575c54f953833d57b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a05e00-557e-56be-9199-01c5577554c4/32a05e00-557e-56be-9199-01c5577554c4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/cd/cbcd16ad7318fba2454ae3afbcadad92/pa/BW81707_b69acec6b47dc2b065b7f22ae009bc69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a05e00-557e-56be-9199-01c5577554c4/32a05e00-557e-56be-9199-01c5577554c4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/cd/cbcd16ad7318fba2454ae3afbcadad92/pa/BW81707_db1ae55b266b93eb9c21d9b581e18d6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a05e00-557e-56be-9199-01c5577554c4/32a05e00-557e-56be-9199-01c5577554c4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82256,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/cd/cbcd16ad7318fba2454ae3afbcadad92/pa/BW81707_8b5952b61d56f96dadfa2bc3b9f8abd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a05e00-557e-56be-9199-01c5577554c4/32a05e00-557e-56be-9199-01c5577554c4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/cd/cbcd16ad7318fba2454ae3afbcadad92/pa/BW81707_1ddf034e52bcec1eeab416ac45970c82.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-01-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Alfa GT 1.8 TS Progression',
 'transmission': 'manual',
 'trim': 'TS Progression',
 'year': 2007}
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW81707%27 HTTP/1.1" 200 None
2026-03-28 12:06:01 [auto1.it] INFO: Saving data for BW81707: {'created_time': 1774699561.035194, 'last_price_update_time': 1774699561.035204, 'auction_closing_time': 1774884726.0}
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BW81707') HTTP/1.1" 204 0
2026-03-28 12:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/30/c530460c0a81b90317d9786974d7cc2d/pa/VK68045_fc0a9bbc704ad1e892d5cfde2b583e3e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_e803b5b959e84cc2d317653a0a5a1a97.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ffa%252F9cfacb2691ab5d058276a609b31b57fc%252Fpa%252FBA01278_502f5de918a01da65bbe0102b49acfce.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_502f5de918a01da65bbe0102b49acfce.jpg not downloaded yet
2026-03-28 12:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZK25339> (referer: https://www.auto1.com/v1/car-details-view/ZK25339/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JZ77925> (referer: https://www.auto1.com/v1/car-details-view/JZ77925/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc273090>
2026-03-28 12:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6997b28-256f-5be2-8aee-fa9e98aee5d0/a6997b28-256f-5be2-8aee-fa9e98aee5d0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb2%252Fd8b22aa72b648f588813415a2db8c709%252Fpa%252FCE47539_f0a71c2dd84490fcf49bc23d949a8880.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_f0a71c2dd84490fcf49bc23d949a8880.jpg saved to cache
2026-03-28 12:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a6997b28-256f-5be2-8aee-fa9e98aee5d0
2026-03-28 12:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc552cd0>
2026-03-28 12:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b157ce1c-c9d1-555e-9b81-8a5e18c654e9/b157ce1c-c9d1-555e-9b81-8a5e18c654e9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F33%252F5633bdfc06003419a52a432aa281149b%252Fpa%252FLN66513_c61073384b40f45a6e74e231a7c9540b.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_c61073384b40f45a6e74e231a7c9540b.jpg saved to cache
2026-03-28 12:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b157ce1c-c9d1-555e-9b81-8a5e18c654e9
2026-03-28 12:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf67d90>
2026-03-28 12:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdb652e9-c41c-5be4-b3fb-00beff0f6480/bdb652e9-c41c-5be4-b3fb-00beff0f6480_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ffa%252F9cfacb2691ab5d058276a609b31b57fc%252Fpa%252FBA01278_107bd98e04f0cef9fb18fb9bbb496045.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_107bd98e04f0cef9fb18fb9bbb496045.jpg saved to cache
2026-03-28 12:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bdb652e9-c41c-5be4-b3fb-00beff0f6480
2026-03-28 12:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_fa941e6bda5226faae6600b8ee0dd592.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PW96424> (referer: https://www.auto1.com/v1/car-details-view/PW96424/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PW47751> (referer: https://www.auto1.com/v1/car-details-view/PW47751/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VZ92626> (referer: https://www.auto1.com/v1/car-details-view/VZ92626/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TF83722> (referer: https://www.auto1.com/v1/car-details-view/TF83722/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ffa%252F9cfacb2691ab5d058276a609b31b57fc%252Fpa%252FBA01278_ae8f3e3b24480b9fe2557ef0de08005c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_ae8f3e3b24480b9fe2557ef0de08005c.jpg not downloaded yet
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ffa%252F9cfacb2691ab5d058276a609b31b57fc%252Fpa%252FBA01278_e80d0e411cc62b87cfc63a4063e9b195.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_e80d0e411cc62b87cfc63a4063e9b195.jpg not downloaded yet
2026-03-28 12:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3ce990>
2026-03-28 12:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_804a424d-3bfa-54e1-bf0b-df648ed2354b/804a424d-3bfa-54e1-bf0b-df648ed2354b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F30%252Fc530460c0a81b90317d9786974d7cc2d%252Fpa%252FVK68045_fc0a9bbc704ad1e892d5cfde2b583e3e.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/30/c530460c0a81b90317d9786974d7cc2d/pa/VK68045_fc0a9bbc704ad1e892d5cfde2b583e3e.jpg saved to cache
2026-03-28 12:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 804a424d-3bfa-54e1-bf0b-df648ed2354b
2026-03-28 12:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf38e90>
2026-03-28 12:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d9c297f-ad9d-5faf-b514-c63740f12274/0d9c297f-ad9d-5faf-b514-c63740f12274_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F7c%252Fdd7c761b1f331ce08fb2bd0a4206ace4%252Fpa%252FWA05506_e803b5b959e84cc2d317653a0a5a1a97.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_e803b5b959e84cc2d317653a0a5a1a97.jpg saved to cache
2026-03-28 12:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0d9c297f-ad9d-5faf-b514-c63740f12274
2026-03-28 12:06:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19f93518-da89-5cb0-87ba-5969728c3566 with identifier: ZK25339
2026-03-28 12:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19f93518-da89-5cb0-87ba-5969728c3566 with scrape type 1
2026-03-28 12:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 19f93518-da89-5cb0-87ba-5969728c3566
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F6e%252F7c6e35f5419e4335e2625a368d4c47b6%252Fpa%252FZK25339_32c7ee0bae949936157d91500e71f3b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/6e/7c6e35f5419e4335e2625a368d4c47b6/pa/ZK25339_32c7ee0bae949936157d91500e71f3b7.jpg already downloaded
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F6e%252F7c6e35f5419e4335e2625a368d4c47b6%252Fpa%252FZK25339_076a558e9e456522989ca98fc3cdf6e6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/6e/7c6e35f5419e4335e2625a368d4c47b6/pa/ZK25339_076a558e9e456522989ca98fc3cdf6e6.jpg already downloaded
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F6e%252F7c6e35f5419e4335e2625a368d4c47b6%252Fpa%252FZK25339_2c1242ec7bdd2fe4e84e27a99360d28d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/6e/7c6e35f5419e4335e2625a368d4c47b6/pa/ZK25339_2c1242ec7bdd2fe4e84e27a99360d28d.jpg already downloaded
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F6e%252F7c6e35f5419e4335e2625a368d4c47b6%252Fpa%252FZK25339_d2b413225f94d80c5d0fa340dea3932a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/6e/7c6e35f5419e4335e2625a368d4c47b6/pa/ZK25339_d2b413225f94d80c5d0fa340dea3932a.jpg already downloaded
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F6e%252F7c6e35f5419e4335e2625a368d4c47b6%252Fpa%252FZK25339_5460607c3a0adf7895176882862ed03c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/6e/7c6e35f5419e4335e2625a368d4c47b6/pa/ZK25339_5460607c3a0adf7895176882862ed03c.jpg already downloaded
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F6e%252F7c6e35f5419e4335e2625a368d4c47b6%252Fpa%252FZK25339_38d1b19e282ed5eb685dde7f56f5d7fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/6e/7c6e35f5419e4335e2625a368d4c47b6/pa/ZK25339_38d1b19e282ed5eb685dde7f56f5d7fe.jpg already downloaded
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F6e%252F7c6e35f5419e4335e2625a368d4c47b6%252Fpa%252FZK25339_003a2ecf770d4ed2411eae3a61c02d91.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/6e/7c6e35f5419e4335e2625a368d4c47b6/pa/ZK25339_003a2ecf770d4ed2411eae3a61c02d91.jpg already downloaded
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F6e%252F7c6e35f5419e4335e2625a368d4c47b6%252Fpa%252FZK25339_392b9a03563ec5d912ff552c5032ef43.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/6e/7c6e35f5419e4335e2625a368d4c47b6/pa/ZK25339_392b9a03563ec5d912ff552c5032ef43.jpg already downloaded
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F6e%252F7c6e35f5419e4335e2625a368d4c47b6%252Fpa%252FZK25339_9121ae952d87eec3560ec6ae930f9fe5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/6e/7c6e35f5419e4335e2625a368d4c47b6/pa/ZK25339_9121ae952d87eec3560ec6ae930f9fe5.jpg already downloaded
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F6e%252F7c6e35f5419e4335e2625a368d4c47b6%252Fpa%252FZK25339_e0a19cd4a5de568818549fa8f45a191f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/6e/7c6e35f5419e4335e2625a368d4c47b6/pa/ZK25339_e0a19cd4a5de568818549fa8f45a191f.jpg already downloaded
2026-03-28 12:06:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 19f93518-da89-5cb0-87ba-5969728c3566, identifier: ZK25339
2026-03-28 12:06:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 859efc99-201c-5de7-8656-ad1f0f754ed1 with identifier: JZ77925
2026-03-28 12:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 859efc99-201c-5de7-8656-ad1f0f754ed1 with scrape type 1
2026-03-28 12:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 859efc99-201c-5de7-8656-ad1f0f754ed1
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fec%252Fe8ecdd33035e6f840eec212bb1d7e560%252Fpa%252FJZ77925_3ddee0b3ab03e0d3b77475bcf246d306.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_3ddee0b3ab03e0d3b77475bcf246d306.jpg not downloaded yet
2026-03-28 12:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_604cb0b3427e121e88f4ddb1b63b04f2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ffa%252F9cfacb2691ab5d058276a609b31b57fc%252Fpa%252FBA01278_28acfe84ed01192d707562d3ba9ea8dd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_28acfe84ed01192d707562d3ba9ea8dd.jpg not downloaded yet
2026-03-28 12:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 19f93518-da89-5cb0-87ba-5969728c3566 with identifier: ZK25339
2026-03-28 12:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 19f93518-da89-5cb0-87ba-5969728c3566 with identifier: ZK25339
2026-03-28 12:06:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 19f93518-da89-5cb0-87ba-5969728c3566 with identifier: ZK25339 to the API
2026-03-28 12:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZK25339>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:38:36Z',
 'fuel_type': 'petrol',
 'id': '19f93518-da89-5cb0-87ba-5969728c3566',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK25339',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 220508,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img7c/6e/7c6e35f5419e4335e2625a368d4c47b6/pa/ZK25339_32c7ee0bae949936157d91500e71f3b7.jpg',
                'https://img-pa.auto1.com/img7c/6e/7c6e35f5419e4335e2625a368d4c47b6/pa/ZK25339_076a558e9e456522989ca98fc3cdf6e6.jpg',
                'https://img-pa.auto1.com/img7c/6e/7c6e35f5419e4335e2625a368d4c47b6/pa/ZK25339_2c1242ec7bdd2fe4e84e27a99360d28d.jpg',
                'https://img-pa.auto1.com/img7c/6e/7c6e35f5419e4335e2625a368d4c47b6/pa/ZK25339_d2b413225f94d80c5d0fa340dea3932a.jpg',
                'https://img-pa.auto1.com/img7c/6e/7c6e35f5419e4335e2625a368d4c47b6/pa/ZK25339_5460607c3a0adf7895176882862ed03c.jpg',
                'https://img-pa.auto1.com/img7c/6e/7c6e35f5419e4335e2625a368d4c47b6/pa/ZK25339_38d1b19e282ed5eb685dde7f56f5d7fe.jpg',
                'https://img-pa.auto1.com/img7c/6e/7c6e35f5419e4335e2625a368d4c47b6/pa/ZK25339_003a2ecf770d4ed2411eae3a61c02d91.jpg',
                'https://img-pa.auto1.com/img7c/6e/7c6e35f5419e4335e2625a368d4c47b6/pa/ZK25339_392b9a03563ec5d912ff552c5032ef43.jpg',
                'https://img-pa.auto1.com/img7c/6e/7c6e35f5419e4335e2625a368d4c47b6/pa/ZK25339_9121ae952d87eec3560ec6ae930f9fe5.jpg',
                'https://img-pa.auto1.com/img7c/6e/7c6e35f5419e4335e2625a368d4c47b6/pa/ZK25339_e0a19cd4a5de568818549fa8f45a191f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f93518-da89-5cb0-87ba-5969728c3566/19f93518-da89-5cb0-87ba-5969728c3566_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/6e/7c6e35f5419e4335e2625a368d4c47b6/pa/ZK25339_32c7ee0bae949936157d91500e71f3b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f93518-da89-5cb0-87ba-5969728c3566/19f93518-da89-5cb0-87ba-5969728c3566_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2414712,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/6e/7c6e35f5419e4335e2625a368d4c47b6/pa/ZK25339_076a558e9e456522989ca98fc3cdf6e6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f93518-da89-5cb0-87ba-5969728c3566/19f93518-da89-5cb0-87ba-5969728c3566_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/6e/7c6e35f5419e4335e2625a368d4c47b6/pa/ZK25339_2c1242ec7bdd2fe4e84e27a99360d28d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f93518-da89-5cb0-87ba-5969728c3566/19f93518-da89-5cb0-87ba-5969728c3566_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2112691,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/6e/7c6e35f5419e4335e2625a368d4c47b6/pa/ZK25339_d2b413225f94d80c5d0fa340dea3932a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f93518-da89-5cb0-87ba-5969728c3566/19f93518-da89-5cb0-87ba-5969728c3566_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57319,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/6e/7c6e35f5419e4335e2625a368d4c47b6/pa/ZK25339_5460607c3a0adf7895176882862ed03c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f93518-da89-5cb0-87ba-5969728c3566/19f93518-da89-5cb0-87ba-5969728c3566_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/6e/7c6e35f5419e4335e2625a368d4c47b6/pa/ZK25339_38d1b19e282ed5eb685dde7f56f5d7fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f93518-da89-5cb0-87ba-5969728c3566/19f93518-da89-5cb0-87ba-5969728c3566_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2385771,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/6e/7c6e35f5419e4335e2625a368d4c47b6/pa/ZK25339_003a2ecf770d4ed2411eae3a61c02d91.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f93518-da89-5cb0-87ba-5969728c3566/19f93518-da89-5cb0-87ba-5969728c3566_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/6e/7c6e35f5419e4335e2625a368d4c47b6/pa/ZK25339_392b9a03563ec5d912ff552c5032ef43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f93518-da89-5cb0-87ba-5969728c3566/19f93518-da89-5cb0-87ba-5969728c3566_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2723881,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/6e/7c6e35f5419e4335e2625a368d4c47b6/pa/ZK25339_9121ae952d87eec3560ec6ae930f9fe5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f93518-da89-5cb0-87ba-5969728c3566/19f93518-da89-5cb0-87ba-5969728c3566_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/6e/7c6e35f5419e4335e2625a368d4c47b6/pa/ZK25339_e0a19cd4a5de568818549fa8f45a191f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-01-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2014}
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK25339%27 HTTP/1.1" 200 None
2026-03-28 12:06:02 [auto1.it] INFO: Saving data for ZK25339: {'created_time': 1774699562.117025, 'last_price_update_time': 1774699562.117036, 'auction_closing_time': 1774885116.0}
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZK25339') HTTP/1.1" 204 0
2026-03-28 12:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/30/c530460c0a81b90317d9786974d7cc2d/pa/VK68045_e8099a1c696fe623a3912f8feb303ab6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_d0d1c5b858b8897c4c9279fed3993acd.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fec%252Fe8ecdd33035e6f840eec212bb1d7e560%252Fpa%252FJZ77925_5a67b0138d7a7e977c4144dc92160178.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_5a67b0138d7a7e977c4144dc92160178.jpg not downloaded yet
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ffa%252F9cfacb2691ab5d058276a609b31b57fc%252Fpa%252FBA01278_99677d6bbd24061fc5bcbe2e24e24975.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_99677d6bbd24061fc5bcbe2e24e24975.jpg not downloaded yet
2026-03-28 12:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_cadea7fb2ea86dbcd3bcae482d5bfe5c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fec%252Fe8ecdd33035e6f840eec212bb1d7e560%252Fpa%252FJZ77925_cf623962b3a8176db34c0294cad36087.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_cf623962b3a8176db34c0294cad36087.jpg not downloaded yet
2026-03-28 12:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf65b10>
2026-03-28 12:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d9c297f-ad9d-5faf-b514-c63740f12274/0d9c297f-ad9d-5faf-b514-c63740f12274_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F7c%252Fdd7c761b1f331ce08fb2bd0a4206ace4%252Fpa%252FWA05506_fa941e6bda5226faae6600b8ee0dd592.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_fa941e6bda5226faae6600b8ee0dd592.jpg saved to cache
2026-03-28 12:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0d9c297f-ad9d-5faf-b514-c63740f12274
2026-03-28 12:06:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0437454a-c4ee-5219-afae-d05af5af81e8 with identifier: PW96424
2026-03-28 12:06:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0437454a-c4ee-5219-afae-d05af5af81e8 with scrape type 1
2026-03-28 12:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 0437454a-c4ee-5219-afae-d05af5af81e8
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fd4%252F77d4a4d8187831aefe9f72ac8fc49299%252Fpa%252FPW96424_6f1f4d828a189e27e8356a4a19c3cf15.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/d4/77d4a4d8187831aefe9f72ac8fc49299/pa/PW96424_6f1f4d828a189e27e8356a4a19c3cf15.jpg not downloaded yet
2026-03-28 12:06:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f74791e-15fd-549d-9408-0209871b4e0e with identifier: PW47751
2026-03-28 12:06:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f74791e-15fd-549d-9408-0209871b4e0e with scrape type 1
2026-03-28 12:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3f74791e-15fd-549d-9408-0209871b4e0e
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc8%252F8cc8c9d9675ae598906f9ffed59399aa%252Fpa%252FPW47751_84663fc56210899a5167b9b0ff2ef2c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_84663fc56210899a5167b9b0ff2ef2c2.jpg not downloaded yet
2026-03-28 12:06:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97e1cd2b-d1b2-5397-991c-5860318ef193 with identifier: VZ92626
2026-03-28 12:06:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97e1cd2b-d1b2-5397-991c-5860318ef193 with scrape type 1
2026-03-28 12:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 97e1cd2b-d1b2-5397-991c-5860318ef193
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fa2%252Fb5a23e22a293cddfef7e3a2e66925f00%252Fpa%252FVZ92626_ea55c08d7a4ec714787da00f4e49d78a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_ea55c08d7a4ec714787da00f4e49d78a.jpg not downloaded yet
2026-03-28 12:06:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f068d1a-c219-5ee3-ad76-97ed8854fa78 with identifier: TF83722
2026-03-28 12:06:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f068d1a-c219-5ee3-ad76-97ed8854fa78 with scrape type 1
2026-03-28 12:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 7f068d1a-c219-5ee3-ad76-97ed8854fa78
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F6b%252F4f6b3413409e8f773def408b6bef0ebd%252Fpa%252FTF83722_672d02e89a45753230e893307a1f23d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/6b/4f6b3413409e8f773def408b6bef0ebd/pa/TF83722_672d02e89a45753230e893307a1f23d8.jpg already downloaded
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F6b%252F4f6b3413409e8f773def408b6bef0ebd%252Fpa%252FTF83722_009a5870e5cc25e8b495147e98adb58a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/6b/4f6b3413409e8f773def408b6bef0ebd/pa/TF83722_009a5870e5cc25e8b495147e98adb58a.jpg already downloaded
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F6b%252F4f6b3413409e8f773def408b6bef0ebd%252Fpa%252FTF83722_5721e8726b063b125ea3ee8fda08fbdd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/6b/4f6b3413409e8f773def408b6bef0ebd/pa/TF83722_5721e8726b063b125ea3ee8fda08fbdd.jpg already downloaded
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F6b%252F4f6b3413409e8f773def408b6bef0ebd%252Fpa%252FTF83722_9940e425d2cef6626d6b2788fe753ae9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/6b/4f6b3413409e8f773def408b6bef0ebd/pa/TF83722_9940e425d2cef6626d6b2788fe753ae9.jpg already downloaded
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F6b%252F4f6b3413409e8f773def408b6bef0ebd%252Fpa%252FTF83722_bcfe14eb074a0e78d23f7644e5bb5a08.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/6b/4f6b3413409e8f773def408b6bef0ebd/pa/TF83722_bcfe14eb074a0e78d23f7644e5bb5a08.jpg already downloaded
2026-03-28 12:06:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7f068d1a-c219-5ee3-ad76-97ed8854fa78, identifier: TF83722
2026-03-28 12:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf658d0>
2026-03-28 12:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdb652e9-c41c-5be4-b3fb-00beff0f6480/bdb652e9-c41c-5be4-b3fb-00beff0f6480_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ffa%252F9cfacb2691ab5d058276a609b31b57fc%252Fpa%252FBA01278_604cb0b3427e121e88f4ddb1b63b04f2.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_604cb0b3427e121e88f4ddb1b63b04f2.jpg saved to cache
2026-03-28 12:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bdb652e9-c41c-5be4-b3fb-00beff0f6480
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fec%252Fe8ecdd33035e6f840eec212bb1d7e560%252Fpa%252FJZ77925_7393f9e9b7b962f56dcfcdfe166ed99e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_7393f9e9b7b962f56dcfcdfe166ed99e.jpg not downloaded yet
2026-03-28 12:06:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7f068d1a-c219-5ee3-ad76-97ed8854fa78 with identifier: TF83722
2026-03-28 12:06:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7f068d1a-c219-5ee3-ad76-97ed8854fa78 with identifier: TF83722
2026-03-28 12:06:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7f068d1a-c219-5ee3-ad76-97ed8854fa78 with identifier: TF83722 to the API
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TF83722>
{'auction_title': '',
 'c_o_2_emission_value': 178,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '1.6L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:03:25Z',
 'fuel_type': 'petrol',
 'id': '7f068d1a-c219-5ee3-ad76-97ed8854fa78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF83722',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Citroen',
 'model': 'Xsara Picasso',
 'odometer': 118576,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img4f/6b/4f6b3413409e8f773def408b6bef0ebd/pa/TF83722_672d02e89a45753230e893307a1f23d8.jpg',
                'https://img-pa.auto1.com/img4f/6b/4f6b3413409e8f773def408b6bef0ebd/pa/TF83722_009a5870e5cc25e8b495147e98adb58a.jpg',
                'https://img-pa.auto1.com/img4f/6b/4f6b3413409e8f773def408b6bef0ebd/pa/TF83722_5721e8726b063b125ea3ee8fda08fbdd.jpg',
                'https://img-pa.auto1.com/img4f/6b/4f6b3413409e8f773def408b6bef0ebd/pa/TF83722_9940e425d2cef6626d6b2788fe753ae9.jpg',
                'https://img-pa.auto1.com/img4f/6b/4f6b3413409e8f773def408b6bef0ebd/pa/TF83722_bcfe14eb074a0e78d23f7644e5bb5a08.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f068d1a-c219-5ee3-ad76-97ed8854fa78/7f068d1a-c219-5ee3-ad76-97ed8854fa78_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/6b/4f6b3413409e8f773def408b6bef0ebd/pa/TF83722_672d02e89a45753230e893307a1f23d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f068d1a-c219-5ee3-ad76-97ed8854fa78/7f068d1a-c219-5ee3-ad76-97ed8854fa78_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68367,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/6b/4f6b3413409e8f773def408b6bef0ebd/pa/TF83722_009a5870e5cc25e8b495147e98adb58a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f068d1a-c219-5ee3-ad76-97ed8854fa78/7f068d1a-c219-5ee3-ad76-97ed8854fa78_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/6b/4f6b3413409e8f773def408b6bef0ebd/pa/TF83722_5721e8726b063b125ea3ee8fda08fbdd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f068d1a-c219-5ee3-ad76-97ed8854fa78/7f068d1a-c219-5ee3-ad76-97ed8854fa78_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65992,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/6b/4f6b3413409e8f773def408b6bef0ebd/pa/TF83722_9940e425d2cef6626d6b2788fe753ae9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f068d1a-c219-5ee3-ad76-97ed8854fa78/7f068d1a-c219-5ee3-ad76-97ed8854fa78_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/6b/4f6b3413409e8f773def408b6bef0ebd/pa/TF83722_bcfe14eb074a0e78d23f7644e5bb5a08.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-04-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Xsara Picasso 1.6 Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2003}
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF83722%27 HTTP/1.1" 200 None
2026-03-28 12:06:02 [auto1.it] INFO: Saving data for TF83722: {'created_time': 1774699562.890582, 'last_price_update_time': 1774699562.890594, 'auction_closing_time': 1774883005.0}
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TF83722') HTTP/1.1" 204 0
2026-03-28 12:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_502f5de918a01da65bbe0102b49acfce.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_8589214ceb3fd895cf6a5321af4a8bf2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/30/c530460c0a81b90317d9786974d7cc2d/pa/VK68045_92cc1d995bec1463f2f0e56b6803ae65.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fd4%252F77d4a4d8187831aefe9f72ac8fc49299%252Fpa%252FPW96424_fa5d639d89dc436260f69dad2e44ad5e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/d4/77d4a4d8187831aefe9f72ac8fc49299/pa/PW96424_fa5d639d89dc436260f69dad2e44ad5e.jpg not downloaded yet
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc8%252F8cc8c9d9675ae598906f9ffed59399aa%252Fpa%252FPW47751_146c9ea107acb7208d1f41a91ed0707e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_146c9ea107acb7208d1f41a91ed0707e.jpg not downloaded yet
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fa2%252Fb5a23e22a293cddfef7e3a2e66925f00%252Fpa%252FVZ92626_def0d4930648fff1d9c9bb19ae5f0367.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_def0d4930648fff1d9c9bb19ae5f0367.jpg not downloaded yet
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fec%252Fe8ecdd33035e6f840eec212bb1d7e560%252Fpa%252FJZ77925_2e3ba74afcb31722324afb6bf378501b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_2e3ba74afcb31722324afb6bf378501b.jpg not downloaded yet
2026-03-28 12:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/30/c530460c0a81b90317d9786974d7cc2d/pa/VK68045_dd38b2235453bde180f625c8a011b47d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fd4%252F77d4a4d8187831aefe9f72ac8fc49299%252Fpa%252FPW96424_4fe28b62e3b3b5166ccd917e52663666.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/d4/77d4a4d8187831aefe9f72ac8fc49299/pa/PW96424_4fe28b62e3b3b5166ccd917e52663666.jpg not downloaded yet
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc8%252F8cc8c9d9675ae598906f9ffed59399aa%252Fpa%252FPW47751_b9f56c368e0b1d6601ded513b3073a65.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_b9f56c368e0b1d6601ded513b3073a65.jpg not downloaded yet
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fa2%252Fb5a23e22a293cddfef7e3a2e66925f00%252Fpa%252FVZ92626_ea7bf7c23647260a30f55ae9ad60dd5b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_ea7bf7c23647260a30f55ae9ad60dd5b.jpg not downloaded yet
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fec%252Fe8ecdd33035e6f840eec212bb1d7e560%252Fpa%252FJZ77925_d22b21fb5e8acac70f76e6bb5d8bbc20.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_d22b21fb5e8acac70f76e6bb5d8bbc20.jpg not downloaded yet
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc522350>
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_804a424d-3bfa-54e1-bf0b-df648ed2354b/804a424d-3bfa-54e1-bf0b-df648ed2354b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F30%252Fc530460c0a81b90317d9786974d7cc2d%252Fpa%252FVK68045_e8099a1c696fe623a3912f8feb303ab6.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/30/c530460c0a81b90317d9786974d7cc2d/pa/VK68045_e8099a1c696fe623a3912f8feb303ab6.jpg saved to cache
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 804a424d-3bfa-54e1-bf0b-df648ed2354b
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04beec8210>
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdb652e9-c41c-5be4-b3fb-00beff0f6480/bdb652e9-c41c-5be4-b3fb-00beff0f6480_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ffa%252F9cfacb2691ab5d058276a609b31b57fc%252Fpa%252FBA01278_d0d1c5b858b8897c4c9279fed3993acd.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_d0d1c5b858b8897c4c9279fed3993acd.jpg saved to cache
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bdb652e9-c41c-5be4-b3fb-00beff0f6480
2026-03-28 12:06:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcea4f90>
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6997b28-256f-5be2-8aee-fa9e98aee5d0/a6997b28-256f-5be2-8aee-fa9e98aee5d0_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb2%252Fd8b22aa72b648f588813415a2db8c709%252Fpa%252FCE47539_cadea7fb2ea86dbcd3bcae482d5bfe5c.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_cadea7fb2ea86dbcd3bcae482d5bfe5c.jpg saved to cache
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a6997b28-256f-5be2-8aee-fa9e98aee5d0
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fd4%252F77d4a4d8187831aefe9f72ac8fc49299%252Fpa%252FPW96424_e812ab7a42d0f944b260bfab06ed790d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/d4/77d4a4d8187831aefe9f72ac8fc49299/pa/PW96424_e812ab7a42d0f944b260bfab06ed790d.jpg not downloaded yet
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc8%252F8cc8c9d9675ae598906f9ffed59399aa%252Fpa%252FPW47751_a82a00984cf143231933c7442bdc61d5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_a82a00984cf143231933c7442bdc61d5.jpg not downloaded yet
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fa2%252Fb5a23e22a293cddfef7e3a2e66925f00%252Fpa%252FVZ92626_91250fac9acbc1ae3ff7cc4d332beffe.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_91250fac9acbc1ae3ff7cc4d332beffe.jpg not downloaded yet
2026-03-28 12:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_28a5ebbd5f6f47c8bb5fa8d0b887c798.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fec%252Fe8ecdd33035e6f840eec212bb1d7e560%252Fpa%252FJZ77925_aa84707cec362caf918ff28a17b9abae.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_aa84707cec362caf918ff28a17b9abae.jpg not downloaded yet
2026-03-28 12:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/30/c530460c0a81b90317d9786974d7cc2d/pa/VK68045_d25f03619753519925ed0c17920c13cf.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_94fa9cdf89bd6d88379e448239c0d310.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fd4%252F77d4a4d8187831aefe9f72ac8fc49299%252Fpa%252FPW96424_181cc82a545566c5a8266fbf7317fe25.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/d4/77d4a4d8187831aefe9f72ac8fc49299/pa/PW96424_181cc82a545566c5a8266fbf7317fe25.jpg not downloaded yet
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc8%252F8cc8c9d9675ae598906f9ffed59399aa%252Fpa%252FPW47751_b2792d58b94a14c5fe949384603a3818.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_b2792d58b94a14c5fe949384603a3818.jpg not downloaded yet
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fa2%252Fb5a23e22a293cddfef7e3a2e66925f00%252Fpa%252FVZ92626_50f3e23ea19f02e90ea70408271210bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_50f3e23ea19f02e90ea70408271210bc.jpg not downloaded yet
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcea2a10>
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdb652e9-c41c-5be4-b3fb-00beff0f6480/bdb652e9-c41c-5be4-b3fb-00beff0f6480_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ffa%252F9cfacb2691ab5d058276a609b31b57fc%252Fpa%252FBA01278_502f5de918a01da65bbe0102b49acfce.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_502f5de918a01da65bbe0102b49acfce.jpg saved to cache
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bdb652e9-c41c-5be4-b3fb-00beff0f6480
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc592c50>
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdb652e9-c41c-5be4-b3fb-00beff0f6480/bdb652e9-c41c-5be4-b3fb-00beff0f6480_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ffa%252F9cfacb2691ab5d058276a609b31b57fc%252Fpa%252FBA01278_8589214ceb3fd895cf6a5321af4a8bf2.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_8589214ceb3fd895cf6a5321af4a8bf2.jpg saved to cache
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bdb652e9-c41c-5be4-b3fb-00beff0f6480
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bceb47d0>
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_804a424d-3bfa-54e1-bf0b-df648ed2354b/804a424d-3bfa-54e1-bf0b-df648ed2354b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F30%252Fc530460c0a81b90317d9786974d7cc2d%252Fpa%252FVK68045_92cc1d995bec1463f2f0e56b6803ae65.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/30/c530460c0a81b90317d9786974d7cc2d/pa/VK68045_92cc1d995bec1463f2f0e56b6803ae65.jpg saved to cache
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 804a424d-3bfa-54e1-bf0b-df648ed2354b
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc270450>
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_804a424d-3bfa-54e1-bf0b-df648ed2354b/804a424d-3bfa-54e1-bf0b-df648ed2354b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F30%252Fc530460c0a81b90317d9786974d7cc2d%252Fpa%252FVK68045_dd38b2235453bde180f625c8a011b47d.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/30/c530460c0a81b90317d9786974d7cc2d/pa/VK68045_dd38b2235453bde180f625c8a011b47d.jpg saved to cache
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 804a424d-3bfa-54e1-bf0b-df648ed2354b
2026-03-28 12:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_f47652049c8d37cf37977d1a9ec0bb25.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fec%252Fe8ecdd33035e6f840eec212bb1d7e560%252Fpa%252FJZ77925_6f3d4c38aef4e0ef997ae4923437d58a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_6f3d4c38aef4e0ef997ae4923437d58a.jpg not downloaded yet
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc8%252F8cc8c9d9675ae598906f9ffed59399aa%252Fpa%252FPW47751_fce1d89b1c75c290f36d438914a9eda5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_fce1d89b1c75c290f36d438914a9eda5.jpg not downloaded yet
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fec%252Fe8ecdd33035e6f840eec212bb1d7e560%252Fpa%252FJZ77925_e2979153e6b048e8bf7048cdb71ab788.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_e2979153e6b048e8bf7048cdb71ab788.jpg not downloaded yet
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc610e90>
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d9c297f-ad9d-5faf-b514-c63740f12274/0d9c297f-ad9d-5faf-b514-c63740f12274_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F7c%252Fdd7c761b1f331ce08fb2bd0a4206ace4%252Fpa%252FWA05506_28a5ebbd5f6f47c8bb5fa8d0b887c798.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_28a5ebbd5f6f47c8bb5fa8d0b887c798.jpg saved to cache
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0d9c297f-ad9d-5faf-b514-c63740f12274
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3f6990>
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_804a424d-3bfa-54e1-bf0b-df648ed2354b/804a424d-3bfa-54e1-bf0b-df648ed2354b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F30%252Fc530460c0a81b90317d9786974d7cc2d%252Fpa%252FVK68045_d25f03619753519925ed0c17920c13cf.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/30/c530460c0a81b90317d9786974d7cc2d/pa/VK68045_d25f03619753519925ed0c17920c13cf.jpg saved to cache
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 804a424d-3bfa-54e1-bf0b-df648ed2354b
2026-03-28 12:06:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 804a424d-3bfa-54e1-bf0b-df648ed2354b, skipping ID generation
2026-03-28 12:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 804a424d-3bfa-54e1-bf0b-df648ed2354b with scrape type 1
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 804a424d-3bfa-54e1-bf0b-df648ed2354b sending to next pipeline
2026-03-28 12:06:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 804a424d-3bfa-54e1-bf0b-df648ed2354b, identifier: VK68045
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bf6e1190>
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdb652e9-c41c-5be4-b3fb-00beff0f6480/bdb652e9-c41c-5be4-b3fb-00beff0f6480_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ffa%252F9cfacb2691ab5d058276a609b31b57fc%252Fpa%252FBA01278_94fa9cdf89bd6d88379e448239c0d310.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_94fa9cdf89bd6d88379e448239c0d310.jpg saved to cache
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bdb652e9-c41c-5be4-b3fb-00beff0f6480
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc8%252F8cc8c9d9675ae598906f9ffed59399aa%252Fpa%252FPW47751_2bb92280e43c7bc3f1e094e1892f9160.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_2bb92280e43c7bc3f1e094e1892f9160.jpg not downloaded yet
2026-03-28 12:06:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 804a424d-3bfa-54e1-bf0b-df648ed2354b with identifier: VK68045
2026-03-28 12:06:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 804a424d-3bfa-54e1-bf0b-df648ed2354b with identifier: VK68045
2026-03-28 12:06:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 804a424d-3bfa-54e1-bf0b-df648ed2354b with identifier: VK68045 to the API
2026-03-28 12:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc5/30/c530460c0a81b90317d9786974d7cc2d/pa/VK68045_d25f03619753519925ed0c17920c13cf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:30:00Z',
 'fuel_type': 'diesel',
 'id': '804a424d-3bfa-54e1-bf0b-df648ed2354b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK68045',
 'listing': 'auction',
 'location': 'IT, Tradein',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 183982,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_804a424d-3bfa-54e1-bf0b-df648ed2354b/804a424d-3bfa-54e1-bf0b-df648ed2354b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128839,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/30/c530460c0a81b90317d9786974d7cc2d/pa/VK68045_fc0a9bbc704ad1e892d5cfde2b583e3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_804a424d-3bfa-54e1-bf0b-df648ed2354b/804a424d-3bfa-54e1-bf0b-df648ed2354b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 139007,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/30/c530460c0a81b90317d9786974d7cc2d/pa/VK68045_d25f03619753519925ed0c17920c13cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_804a424d-3bfa-54e1-bf0b-df648ed2354b/804a424d-3bfa-54e1-bf0b-df648ed2354b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/30/c530460c0a81b90317d9786974d7cc2d/pa/VK68045_e8099a1c696fe623a3912f8feb303ab6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_804a424d-3bfa-54e1-bf0b-df648ed2354b/804a424d-3bfa-54e1-bf0b-df648ed2354b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/30/c530460c0a81b90317d9786974d7cc2d/pa/VK68045_dd38b2235453bde180f625c8a011b47d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_804a424d-3bfa-54e1-bf0b-df648ed2354b/804a424d-3bfa-54e1-bf0b-df648ed2354b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/30/c530460c0a81b90317d9786974d7cc2d/pa/VK68045_92cc1d995bec1463f2f0e56b6803ae65.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.6 HDi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2010}
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK68045%27 HTTP/1.1" 200 None
2026-03-28 12:06:04 [auto1.it] INFO: Saving data for VK68045: {'created_time': 1774699564.232475, 'last_price_update_time': 1774699564.232486, 'auction_closing_time': 1774884600.0}
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VK68045') HTTP/1.1" 204 0
2026-03-28 12:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_99677d6bbd24061fc5bcbe2e24e24975.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_e80d0e411cc62b87cfc63a4063e9b195.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_ae8f3e3b24480b9fe2557ef0de08005c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_3ddee0b3ab03e0d3b77475bcf246d306.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fec%252Fe8ecdd33035e6f840eec212bb1d7e560%252Fpa%252FJZ77925_e34494b98c2898a221b80ed0c30a02d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_e34494b98c2898a221b80ed0c30a02d9.jpg not downloaded yet
2026-03-28 12:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_9c4b463515498537fd88a1209c2b2b8b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc8%252F8cc8c9d9675ae598906f9ffed59399aa%252Fpa%252FPW47751_b0c21628723b0b9b79528e9fdc24ea62.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_b0c21628723b0b9b79528e9fdc24ea62.jpg not downloaded yet
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf27a90>
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d9c297f-ad9d-5faf-b514-c63740f12274/0d9c297f-ad9d-5faf-b514-c63740f12274_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F7c%252Fdd7c761b1f331ce08fb2bd0a4206ace4%252Fpa%252FWA05506_f47652049c8d37cf37977d1a9ec0bb25.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_f47652049c8d37cf37977d1a9ec0bb25.jpg saved to cache
2026-03-28 12:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0d9c297f-ad9d-5faf-b514-c63740f12274
2026-03-28 12:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_76c4a835c2909655460649c151300053.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc8%252F8cc8c9d9675ae598906f9ffed59399aa%252Fpa%252FPW47751_0cfd03321938e2bcc2068946343a3b11.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_0cfd03321938e2bcc2068946343a3b11.jpg not downloaded yet
2026-03-28 12:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_dcb582b5f4a9f15d8ee656081edea095.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_84663fc56210899a5167b9b0ff2ef2c2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_2e3ba74afcb31722324afb6bf378501b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/d4/77d4a4d8187831aefe9f72ac8fc49299/pa/PW96424_6f1f4d828a189e27e8356a4a19c3cf15.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_ea55c08d7a4ec714787da00f4e49d78a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc8%252F8cc8c9d9675ae598906f9ffed59399aa%252Fpa%252FPW47751_7a79ef499d476e8d01a045a33bd0ff7d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_7a79ef499d476e8d01a045a33bd0ff7d.jpg not downloaded yet
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc645f50>
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdb652e9-c41c-5be4-b3fb-00beff0f6480/bdb652e9-c41c-5be4-b3fb-00beff0f6480_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ffa%252F9cfacb2691ab5d058276a609b31b57fc%252Fpa%252FBA01278_99677d6bbd24061fc5bcbe2e24e24975.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_99677d6bbd24061fc5bcbe2e24e24975.jpg saved to cache
2026-03-28 12:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bdb652e9-c41c-5be4-b3fb-00beff0f6480
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5d6590>
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdb652e9-c41c-5be4-b3fb-00beff0f6480/bdb652e9-c41c-5be4-b3fb-00beff0f6480_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ffa%252F9cfacb2691ab5d058276a609b31b57fc%252Fpa%252FBA01278_e80d0e411cc62b87cfc63a4063e9b195.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_e80d0e411cc62b87cfc63a4063e9b195.jpg saved to cache
2026-03-28 12:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bdb652e9-c41c-5be4-b3fb-00beff0f6480
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc377e50>
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdb652e9-c41c-5be4-b3fb-00beff0f6480/bdb652e9-c41c-5be4-b3fb-00beff0f6480_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ffa%252F9cfacb2691ab5d058276a609b31b57fc%252Fpa%252FBA01278_ae8f3e3b24480b9fe2557ef0de08005c.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_ae8f3e3b24480b9fe2557ef0de08005c.jpg saved to cache
2026-03-28 12:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bdb652e9-c41c-5be4-b3fb-00beff0f6480
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3dd0d0>
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_859efc99-201c-5de7-8656-ad1f0f754ed1/859efc99-201c-5de7-8656-ad1f0f754ed1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fec%252Fe8ecdd33035e6f840eec212bb1d7e560%252Fpa%252FJZ77925_3ddee0b3ab03e0d3b77475bcf246d306.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_3ddee0b3ab03e0d3b77475bcf246d306.jpg saved to cache
2026-03-28 12:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 859efc99-201c-5de7-8656-ad1f0f754ed1
2026-03-28 12:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_82748b92187dc6cc617b427ba597badd.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_91250fac9acbc1ae3ff7cc4d332beffe.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_aa84707cec362caf918ff28a17b9abae.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bef06790>
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6997b28-256f-5be2-8aee-fa9e98aee5d0/a6997b28-256f-5be2-8aee-fa9e98aee5d0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb2%252Fd8b22aa72b648f588813415a2db8c709%252Fpa%252FCE47539_9c4b463515498537fd88a1209c2b2b8b.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_9c4b463515498537fd88a1209c2b2b8b.jpg saved to cache
2026-03-28 12:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a6997b28-256f-5be2-8aee-fa9e98aee5d0
2026-03-28 12:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_e2979153e6b048e8bf7048cdb71ab788.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_6f3d4c38aef4e0ef997ae4923437d58a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/d4/77d4a4d8187831aefe9f72ac8fc49299/pa/PW96424_e812ab7a42d0f944b260bfab06ed790d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_fce1d89b1c75c290f36d438914a9eda5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bce9bfd0>
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6997b28-256f-5be2-8aee-fa9e98aee5d0/a6997b28-256f-5be2-8aee-fa9e98aee5d0_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb2%252Fd8b22aa72b648f588813415a2db8c709%252Fpa%252FCE47539_76c4a835c2909655460649c151300053.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_76c4a835c2909655460649c151300053.jpg saved to cache
2026-03-28 12:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a6997b28-256f-5be2-8aee-fa9e98aee5d0
2026-03-28 12:06:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3b22d0>
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b157ce1c-c9d1-555e-9b81-8a5e18c654e9/b157ce1c-c9d1-555e-9b81-8a5e18c654e9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F33%252F5633bdfc06003419a52a432aa281149b%252Fpa%252FLN66513_dcb582b5f4a9f15d8ee656081edea095.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_dcb582b5f4a9f15d8ee656081edea095.jpg saved to cache
2026-03-28 12:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b157ce1c-c9d1-555e-9b81-8a5e18c654e9
2026-03-28 12:06:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b157ce1c-c9d1-555e-9b81-8a5e18c654e9, skipping ID generation
2026-03-28 12:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b157ce1c-c9d1-555e-9b81-8a5e18c654e9 with scrape type 1
2026-03-28 12:06:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b157ce1c-c9d1-555e-9b81-8a5e18c654e9 sending to next pipeline
2026-03-28 12:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b157ce1c-c9d1-555e-9b81-8a5e18c654e9, identifier: LN66513
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc54f050>
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f74791e-15fd-549d-9408-0209871b4e0e/3f74791e-15fd-549d-9408-0209871b4e0e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc8%252F8cc8c9d9675ae598906f9ffed59399aa%252Fpa%252FPW47751_84663fc56210899a5167b9b0ff2ef2c2.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_84663fc56210899a5167b9b0ff2ef2c2.jpg saved to cache
2026-03-28 12:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f74791e-15fd-549d-9408-0209871b4e0e
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3750d0>
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_859efc99-201c-5de7-8656-ad1f0f754ed1/859efc99-201c-5de7-8656-ad1f0f754ed1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fec%252Fe8ecdd33035e6f840eec212bb1d7e560%252Fpa%252FJZ77925_2e3ba74afcb31722324afb6bf378501b.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_2e3ba74afcb31722324afb6bf378501b.jpg saved to cache
2026-03-28 12:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 859efc99-201c-5de7-8656-ad1f0f754ed1
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf04810>
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0437454a-c4ee-5219-afae-d05af5af81e8/0437454a-c4ee-5219-afae-d05af5af81e8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fd4%252F77d4a4d8187831aefe9f72ac8fc49299%252Fpa%252FPW96424_6f1f4d828a189e27e8356a4a19c3cf15.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/d4/77d4a4d8187831aefe9f72ac8fc49299/pa/PW96424_6f1f4d828a189e27e8356a4a19c3cf15.jpg saved to cache
2026-03-28 12:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0437454a-c4ee-5219-afae-d05af5af81e8
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd1571d0>
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97e1cd2b-d1b2-5397-991c-5860318ef193/97e1cd2b-d1b2-5397-991c-5860318ef193_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fa2%252Fb5a23e22a293cddfef7e3a2e66925f00%252Fpa%252FVZ92626_ea55c08d7a4ec714787da00f4e49d78a.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_ea55c08d7a4ec714787da00f4e49d78a.jpg saved to cache
2026-03-28 12:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97e1cd2b-d1b2-5397-991c-5860318ef193
2026-03-28 12:06:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b157ce1c-c9d1-555e-9b81-8a5e18c654e9 with identifier: LN66513
2026-03-28 12:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b157ce1c-c9d1-555e-9b81-8a5e18c654e9 with identifier: LN66513
2026-03-28 12:06:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b157ce1c-c9d1-555e-9b81-8a5e18c654e9 with identifier: LN66513 to the API
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_dcb582b5f4a9f15d8ee656081edea095.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:04:46Z',
 'fuel_type': 'petrol',
 'id': 'b157ce1c-c9d1-555e-9b81-8a5e18c654e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN66513',
 'listing': 'auction',
 'location': 'IT, Verona',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 45752,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b157ce1c-c9d1-555e-9b81-8a5e18c654e9/b157ce1c-c9d1-555e-9b81-8a5e18c654e9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_e531035bcee05f01dfae4ef4a294481a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b157ce1c-c9d1-555e-9b81-8a5e18c654e9/b157ce1c-c9d1-555e-9b81-8a5e18c654e9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_c61073384b40f45a6e74e231a7c9540b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b157ce1c-c9d1-555e-9b81-8a5e18c654e9/b157ce1c-c9d1-555e-9b81-8a5e18c654e9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_4d66a21cd2565bec403e6c71e93e47cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b157ce1c-c9d1-555e-9b81-8a5e18c654e9/b157ce1c-c9d1-555e-9b81-8a5e18c654e9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_bcb8fd8e45ebd38f2c012b8989da2e2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b157ce1c-c9d1-555e-9b81-8a5e18c654e9/b157ce1c-c9d1-555e-9b81-8a5e18c654e9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2398277,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_dcb582b5f4a9f15d8ee656081edea095.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b157ce1c-c9d1-555e-9b81-8a5e18c654e9/b157ce1c-c9d1-555e-9b81-8a5e18c654e9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2313265,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_641bb5ff18c34c7310159e0e732ab097.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b157ce1c-c9d1-555e-9b81-8a5e18c654e9/b157ce1c-c9d1-555e-9b81-8a5e18c654e9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_f79d0954cc5f479a80fa9c19a74f1066.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b157ce1c-c9d1-555e-9b81-8a5e18c654e9/b157ce1c-c9d1-555e-9b81-8a5e18c654e9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2336706,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_fd69a751b0140230358fc68cf4ed5eee.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b157ce1c-c9d1-555e-9b81-8a5e18c654e9/b157ce1c-c9d1-555e-9b81-8a5e18c654e9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_cca3bdc33ad6363f035a2c55df1ab456.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b157ce1c-c9d1-555e-9b81-8a5e18c654e9/b157ce1c-c9d1-555e-9b81-8a5e18c654e9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/33/5633bdfc06003419a52a432aa281149b/pa/LN66513_1babb49b96e1fa4dfce31ee44465afc4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-02-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2011}
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN66513%27 HTTP/1.1" 200 None
2026-03-28 12:06:05 [auto1.it] INFO: Saving data for LN66513: {'created_time': 1774699565.508473, 'last_price_update_time': 1774699565.508483, 'auction_closing_time': 1774883086.0}
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LN66513') HTTP/1.1" 204 0
2026-03-28 12:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_50f3e23ea19f02e90ea70408271210bc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_b0c21628723b0b9b79528e9fdc24ea62.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:05 [scrapy.extensions.logstats] INFO: Crawled 97 pages (at 97 pages/min), scraped 47 items (at 47 items/min)
2026-03-28 12:06:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 192MiB
2026-03-28 12:06:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3e7110>
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6997b28-256f-5be2-8aee-fa9e98aee5d0/a6997b28-256f-5be2-8aee-fa9e98aee5d0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb2%252Fd8b22aa72b648f588813415a2db8c709%252Fpa%252FCE47539_82748b92187dc6cc617b427ba597badd.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_82748b92187dc6cc617b427ba597badd.jpg saved to cache
2026-03-28 12:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a6997b28-256f-5be2-8aee-fa9e98aee5d0
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc593590>
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97e1cd2b-d1b2-5397-991c-5860318ef193/97e1cd2b-d1b2-5397-991c-5860318ef193_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fa2%252Fb5a23e22a293cddfef7e3a2e66925f00%252Fpa%252FVZ92626_91250fac9acbc1ae3ff7cc4d332beffe.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_91250fac9acbc1ae3ff7cc4d332beffe.jpg saved to cache
2026-03-28 12:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 97e1cd2b-d1b2-5397-991c-5860318ef193
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3cedd0>
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_859efc99-201c-5de7-8656-ad1f0f754ed1/859efc99-201c-5de7-8656-ad1f0f754ed1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fec%252Fe8ecdd33035e6f840eec212bb1d7e560%252Fpa%252FJZ77925_aa84707cec362caf918ff28a17b9abae.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_aa84707cec362caf918ff28a17b9abae.jpg saved to cache
2026-03-28 12:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 859efc99-201c-5de7-8656-ad1f0f754ed1
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc591a90>
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_859efc99-201c-5de7-8656-ad1f0f754ed1/859efc99-201c-5de7-8656-ad1f0f754ed1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fec%252Fe8ecdd33035e6f840eec212bb1d7e560%252Fpa%252FJZ77925_e2979153e6b048e8bf7048cdb71ab788.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_e2979153e6b048e8bf7048cdb71ab788.jpg saved to cache
2026-03-28 12:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 859efc99-201c-5de7-8656-ad1f0f754ed1
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc65af10>
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_859efc99-201c-5de7-8656-ad1f0f754ed1/859efc99-201c-5de7-8656-ad1f0f754ed1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fec%252Fe8ecdd33035e6f840eec212bb1d7e560%252Fpa%252FJZ77925_6f3d4c38aef4e0ef997ae4923437d58a.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_6f3d4c38aef4e0ef997ae4923437d58a.jpg saved to cache
2026-03-28 12:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 859efc99-201c-5de7-8656-ad1f0f754ed1
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bef37490>
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0437454a-c4ee-5219-afae-d05af5af81e8/0437454a-c4ee-5219-afae-d05af5af81e8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fd4%252F77d4a4d8187831aefe9f72ac8fc49299%252Fpa%252FPW96424_e812ab7a42d0f944b260bfab06ed790d.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/d4/77d4a4d8187831aefe9f72ac8fc49299/pa/PW96424_e812ab7a42d0f944b260bfab06ed790d.jpg saved to cache
2026-03-28 12:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0437454a-c4ee-5219-afae-d05af5af81e8
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bf6d38d0>
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f74791e-15fd-549d-9408-0209871b4e0e/3f74791e-15fd-549d-9408-0209871b4e0e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc8%252F8cc8c9d9675ae598906f9ffed59399aa%252Fpa%252FPW47751_fce1d89b1c75c290f36d438914a9eda5.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_fce1d89b1c75c290f36d438914a9eda5.jpg saved to cache
2026-03-28 12:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3f74791e-15fd-549d-9408-0209871b4e0e
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc63a510>
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97e1cd2b-d1b2-5397-991c-5860318ef193/97e1cd2b-d1b2-5397-991c-5860318ef193_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fa2%252Fb5a23e22a293cddfef7e3a2e66925f00%252Fpa%252FVZ92626_50f3e23ea19f02e90ea70408271210bc.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_50f3e23ea19f02e90ea70408271210bc.jpg saved to cache
2026-03-28 12:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 97e1cd2b-d1b2-5397-991c-5860318ef193
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc408b50>
2026-03-28 12:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f74791e-15fd-549d-9408-0209871b4e0e/3f74791e-15fd-549d-9408-0209871b4e0e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc8%252F8cc8c9d9675ae598906f9ffed59399aa%252Fpa%252FPW47751_b0c21628723b0b9b79528e9fdc24ea62.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_b0c21628723b0b9b79528e9fdc24ea62.jpg saved to cache
2026-03-28 12:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3f74791e-15fd-549d-9408-0209871b4e0e
2026-03-28 12:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_a82a00984cf143231933c7442bdc61d5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_2bb92280e43c7bc3f1e094e1892f9160.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/d4/77d4a4d8187831aefe9f72ac8fc49299/pa/PW96424_181cc82a545566c5a8266fbf7317fe25.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_ea7bf7c23647260a30f55ae9ad60dd5b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/d4/77d4a4d8187831aefe9f72ac8fc49299/pa/PW96424_4fe28b62e3b3b5166ccd917e52663666.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc38bdd0>
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f74791e-15fd-549d-9408-0209871b4e0e/3f74791e-15fd-549d-9408-0209871b4e0e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc8%252F8cc8c9d9675ae598906f9ffed59399aa%252Fpa%252FPW47751_a82a00984cf143231933c7442bdc61d5.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_a82a00984cf143231933c7442bdc61d5.jpg saved to cache
2026-03-28 12:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3f74791e-15fd-549d-9408-0209871b4e0e
2026-03-28 12:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_e34494b98c2898a221b80ed0c30a02d9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_d22b21fb5e8acac70f76e6bb5d8bbc20.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_def0d4930648fff1d9c9bb19ae5f0367.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_b2792d58b94a14c5fe949384603a3818.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd157010>
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f74791e-15fd-549d-9408-0209871b4e0e/3f74791e-15fd-549d-9408-0209871b4e0e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc8%252F8cc8c9d9675ae598906f9ffed59399aa%252Fpa%252FPW47751_2bb92280e43c7bc3f1e094e1892f9160.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_2bb92280e43c7bc3f1e094e1892f9160.jpg saved to cache
2026-03-28 12:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3f74791e-15fd-549d-9408-0209871b4e0e
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd0f2350>
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0437454a-c4ee-5219-afae-d05af5af81e8/0437454a-c4ee-5219-afae-d05af5af81e8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fd4%252F77d4a4d8187831aefe9f72ac8fc49299%252Fpa%252FPW96424_181cc82a545566c5a8266fbf7317fe25.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/d4/77d4a4d8187831aefe9f72ac8fc49299/pa/PW96424_181cc82a545566c5a8266fbf7317fe25.jpg saved to cache
2026-03-28 12:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0437454a-c4ee-5219-afae-d05af5af81e8
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3e2ed0>
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97e1cd2b-d1b2-5397-991c-5860318ef193/97e1cd2b-d1b2-5397-991c-5860318ef193_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fa2%252Fb5a23e22a293cddfef7e3a2e66925f00%252Fpa%252FVZ92626_ea7bf7c23647260a30f55ae9ad60dd5b.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_ea7bf7c23647260a30f55ae9ad60dd5b.jpg saved to cache
2026-03-28 12:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 97e1cd2b-d1b2-5397-991c-5860318ef193
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc381f90>
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0437454a-c4ee-5219-afae-d05af5af81e8/0437454a-c4ee-5219-afae-d05af5af81e8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fd4%252F77d4a4d8187831aefe9f72ac8fc49299%252Fpa%252FPW96424_4fe28b62e3b3b5166ccd917e52663666.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/d4/77d4a4d8187831aefe9f72ac8fc49299/pa/PW96424_4fe28b62e3b3b5166ccd917e52663666.jpg saved to cache
2026-03-28 12:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0437454a-c4ee-5219-afae-d05af5af81e8
2026-03-28 12:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_7393f9e9b7b962f56dcfcdfe166ed99e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/d4/77d4a4d8187831aefe9f72ac8fc49299/pa/PW96424_fa5d639d89dc436260f69dad2e44ad5e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3e20d0>
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_859efc99-201c-5de7-8656-ad1f0f754ed1/859efc99-201c-5de7-8656-ad1f0f754ed1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fec%252Fe8ecdd33035e6f840eec212bb1d7e560%252Fpa%252FJZ77925_e34494b98c2898a221b80ed0c30a02d9.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_e34494b98c2898a221b80ed0c30a02d9.jpg saved to cache
2026-03-28 12:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 859efc99-201c-5de7-8656-ad1f0f754ed1
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5e7410>
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_859efc99-201c-5de7-8656-ad1f0f754ed1/859efc99-201c-5de7-8656-ad1f0f754ed1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fec%252Fe8ecdd33035e6f840eec212bb1d7e560%252Fpa%252FJZ77925_d22b21fb5e8acac70f76e6bb5d8bbc20.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_d22b21fb5e8acac70f76e6bb5d8bbc20.jpg saved to cache
2026-03-28 12:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 859efc99-201c-5de7-8656-ad1f0f754ed1
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3c6b50>
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97e1cd2b-d1b2-5397-991c-5860318ef193/97e1cd2b-d1b2-5397-991c-5860318ef193_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fa2%252Fb5a23e22a293cddfef7e3a2e66925f00%252Fpa%252FVZ92626_def0d4930648fff1d9c9bb19ae5f0367.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_def0d4930648fff1d9c9bb19ae5f0367.jpg saved to cache
2026-03-28 12:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 97e1cd2b-d1b2-5397-991c-5860318ef193
2026-03-28 12:06:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 97e1cd2b-d1b2-5397-991c-5860318ef193, skipping ID generation
2026-03-28 12:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97e1cd2b-d1b2-5397-991c-5860318ef193 with scrape type 1
2026-03-28 12:06:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 97e1cd2b-d1b2-5397-991c-5860318ef193 sending to next pipeline
2026-03-28 12:06:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 97e1cd2b-d1b2-5397-991c-5860318ef193, identifier: VZ92626
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd010c90>
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f74791e-15fd-549d-9408-0209871b4e0e/3f74791e-15fd-549d-9408-0209871b4e0e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc8%252F8cc8c9d9675ae598906f9ffed59399aa%252Fpa%252FPW47751_b2792d58b94a14c5fe949384603a3818.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_b2792d58b94a14c5fe949384603a3818.jpg saved to cache
2026-03-28 12:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3f74791e-15fd-549d-9408-0209871b4e0e
2026-03-28 12:06:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 97e1cd2b-d1b2-5397-991c-5860318ef193 with identifier: VZ92626
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:06:06 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-28 12:06:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 97e1cd2b-d1b2-5397-991c-5860318ef193 with identifier: VZ92626
2026-03-28 12:06:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 97e1cd2b-d1b2-5397-991c-5860318ef193 with identifier: VZ92626 to the API
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_def0d4930648fff1d9c9bb19ae5f0367.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:49:44Z',
 'fuel_type': 'petrol',
 'id': '97e1cd2b-d1b2-5397-991c-5860318ef193',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ92626',
 'listing': 'auction',
 'location': 'IT, Varese',
 'make': 'Suzuki',
 'model': 'SX4',
 'odometer': 202462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97e1cd2b-d1b2-5397-991c-5860318ef193/97e1cd2b-d1b2-5397-991c-5860318ef193_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_ea55c08d7a4ec714787da00f4e49d78a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97e1cd2b-d1b2-5397-991c-5860318ef193/97e1cd2b-d1b2-5397-991c-5860318ef193_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_def0d4930648fff1d9c9bb19ae5f0367.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97e1cd2b-d1b2-5397-991c-5860318ef193/97e1cd2b-d1b2-5397-991c-5860318ef193_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81114,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_ea7bf7c23647260a30f55ae9ad60dd5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97e1cd2b-d1b2-5397-991c-5860318ef193/97e1cd2b-d1b2-5397-991c-5860318ef193_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_91250fac9acbc1ae3ff7cc4d332beffe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97e1cd2b-d1b2-5397-991c-5860318ef193/97e1cd2b-d1b2-5397-991c-5860318ef193_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_50f3e23ea19f02e90ea70408271210bc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki SX4 1.6 Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2010}
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VZ92626%27 HTTP/1.1" 200 None
2026-03-28 12:06:07 [auto1.it] INFO: Saving data for VZ92626: {'created_time': 1774699567.442583, 'last_price_update_time': 1774699567.442592, 'auction_closing_time': 1774885784.0}
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VZ92626') HTTP/1.1" 204 0
2026-03-28 12:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_cf623962b3a8176db34c0294cad36087.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_28acfe84ed01192d707562d3ba9ea8dd.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_5a67b0138d7a7e977c4144dc92160178.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_0e9586516a5b94ffc889ccc8a9c4473e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd154890>
2026-03-28 12:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_859efc99-201c-5de7-8656-ad1f0f754ed1/859efc99-201c-5de7-8656-ad1f0f754ed1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fec%252Fe8ecdd33035e6f840eec212bb1d7e560%252Fpa%252FJZ77925_7393f9e9b7b962f56dcfcdfe166ed99e.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_7393f9e9b7b962f56dcfcdfe166ed99e.jpg saved to cache
2026-03-28 12:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 859efc99-201c-5de7-8656-ad1f0f754ed1
2026-03-28 12:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc274ad0>
2026-03-28 12:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0437454a-c4ee-5219-afae-d05af5af81e8/0437454a-c4ee-5219-afae-d05af5af81e8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fd4%252F77d4a4d8187831aefe9f72ac8fc49299%252Fpa%252FPW96424_fa5d639d89dc436260f69dad2e44ad5e.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/d4/77d4a4d8187831aefe9f72ac8fc49299/pa/PW96424_fa5d639d89dc436260f69dad2e44ad5e.jpg saved to cache
2026-03-28 12:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0437454a-c4ee-5219-afae-d05af5af81e8
2026-03-28 12:06:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0437454a-c4ee-5219-afae-d05af5af81e8, skipping ID generation
2026-03-28 12:06:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0437454a-c4ee-5219-afae-d05af5af81e8 with scrape type 1
2026-03-28 12:06:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0437454a-c4ee-5219-afae-d05af5af81e8 sending to next pipeline
2026-03-28 12:06:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0437454a-c4ee-5219-afae-d05af5af81e8, identifier: PW96424
2026-03-28 12:06:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0437454a-c4ee-5219-afae-d05af5af81e8 with identifier: PW96424
2026-03-28 12:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0437454a-c4ee-5219-afae-d05af5af81e8 with identifier: PW96424
2026-03-28 12:06:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0437454a-c4ee-5219-afae-d05af5af81e8 with identifier: PW96424 to the API
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img77/d4/77d4a4d8187831aefe9f72ac8fc49299/pa/PW96424_fa5d639d89dc436260f69dad2e44ad5e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:56:16Z',
 'fuel_type': 'petrol',
 'id': '0437454a-c4ee-5219-afae-d05af5af81e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW96424',
 'listing': 'auction',
 'location': 'IT, Fiumicino',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 244130,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0437454a-c4ee-5219-afae-d05af5af81e8/0437454a-c4ee-5219-afae-d05af5af81e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/d4/77d4a4d8187831aefe9f72ac8fc49299/pa/PW96424_6f1f4d828a189e27e8356a4a19c3cf15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0437454a-c4ee-5219-afae-d05af5af81e8/0437454a-c4ee-5219-afae-d05af5af81e8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/d4/77d4a4d8187831aefe9f72ac8fc49299/pa/PW96424_fa5d639d89dc436260f69dad2e44ad5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0437454a-c4ee-5219-afae-d05af5af81e8/0437454a-c4ee-5219-afae-d05af5af81e8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/d4/77d4a4d8187831aefe9f72ac8fc49299/pa/PW96424_4fe28b62e3b3b5166ccd917e52663666.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0437454a-c4ee-5219-afae-d05af5af81e8/0437454a-c4ee-5219-afae-d05af5af81e8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/d4/77d4a4d8187831aefe9f72ac8fc49299/pa/PW96424_e812ab7a42d0f944b260bfab06ed790d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0437454a-c4ee-5219-afae-d05af5af81e8/0437454a-c4ee-5219-afae-d05af5af81e8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/d4/77d4a4d8187831aefe9f72ac8fc49299/pa/PW96424_181cc82a545566c5a8266fbf7317fe25.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-07',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2016}
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW96424%27 HTTP/1.1" 200 None
2026-03-28 12:06:07 [auto1.it] INFO: Saving data for PW96424: {'created_time': 1774699567.99309, 'last_price_update_time': 1774699567.993103, 'auction_closing_time': 1774886176.0}
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PW96424') HTTP/1.1" 204 0
2026-03-28 12:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_463922be767041f935601ec2432d9600.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_b9ab3771da12e8806050cdb07328a2a1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc277550>
2026-03-28 12:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_859efc99-201c-5de7-8656-ad1f0f754ed1/859efc99-201c-5de7-8656-ad1f0f754ed1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fec%252Fe8ecdd33035e6f840eec212bb1d7e560%252Fpa%252FJZ77925_cf623962b3a8176db34c0294cad36087.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_cf623962b3a8176db34c0294cad36087.jpg saved to cache
2026-03-28 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 859efc99-201c-5de7-8656-ad1f0f754ed1
2026-03-28 12:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc4035d0>
2026-03-28 12:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdb652e9-c41c-5be4-b3fb-00beff0f6480/bdb652e9-c41c-5be4-b3fb-00beff0f6480_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ffa%252F9cfacb2691ab5d058276a609b31b57fc%252Fpa%252FBA01278_28acfe84ed01192d707562d3ba9ea8dd.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_28acfe84ed01192d707562d3ba9ea8dd.jpg saved to cache
2026-03-28 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bdb652e9-c41c-5be4-b3fb-00beff0f6480
2026-03-28 12:06:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bdb652e9-c41c-5be4-b3fb-00beff0f6480, skipping ID generation
2026-03-28 12:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdb652e9-c41c-5be4-b3fb-00beff0f6480 with scrape type 1
2026-03-28 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bdb652e9-c41c-5be4-b3fb-00beff0f6480 sending to next pipeline
2026-03-28 12:06:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bdb652e9-c41c-5be4-b3fb-00beff0f6480, identifier: BA01278
2026-03-28 12:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf33950>
2026-03-28 12:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_859efc99-201c-5de7-8656-ad1f0f754ed1/859efc99-201c-5de7-8656-ad1f0f754ed1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fec%252Fe8ecdd33035e6f840eec212bb1d7e560%252Fpa%252FJZ77925_5a67b0138d7a7e977c4144dc92160178.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_5a67b0138d7a7e977c4144dc92160178.jpg saved to cache
2026-03-28 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 859efc99-201c-5de7-8656-ad1f0f754ed1
2026-03-28 12:06:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 859efc99-201c-5de7-8656-ad1f0f754ed1, skipping ID generation
2026-03-28 12:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 859efc99-201c-5de7-8656-ad1f0f754ed1 with scrape type 1
2026-03-28 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 859efc99-201c-5de7-8656-ad1f0f754ed1 sending to next pipeline
2026-03-28 12:06:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 859efc99-201c-5de7-8656-ad1f0f754ed1, identifier: JZ77925
2026-03-28 12:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc658790>
2026-03-28 12:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d9c297f-ad9d-5faf-b514-c63740f12274/0d9c297f-ad9d-5faf-b514-c63740f12274_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F7c%252Fdd7c761b1f331ce08fb2bd0a4206ace4%252Fpa%252FWA05506_0e9586516a5b94ffc889ccc8a9c4473e.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_0e9586516a5b94ffc889ccc8a9c4473e.jpg saved to cache
2026-03-28 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d9c297f-ad9d-5faf-b514-c63740f12274
2026-03-28 12:06:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d9c297f-ad9d-5faf-b514-c63740f12274, skipping ID generation
2026-03-28 12:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d9c297f-ad9d-5faf-b514-c63740f12274 with scrape type 1
2026-03-28 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d9c297f-ad9d-5faf-b514-c63740f12274 sending to next pipeline
2026-03-28 12:06:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0d9c297f-ad9d-5faf-b514-c63740f12274, identifier: WA05506
2026-03-28 12:06:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bdb652e9-c41c-5be4-b3fb-00beff0f6480 with identifier: BA01278
2026-03-28 12:06:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bdb652e9-c41c-5be4-b3fb-00beff0f6480 with identifier: BA01278
2026-03-28 12:06:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bdb652e9-c41c-5be4-b3fb-00beff0f6480 with identifier: BA01278 to the API
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_28acfe84ed01192d707562d3ba9ea8dd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:48:10Z',
 'fuel_type': 'petrol',
 'id': 'bdb652e9-c41c-5be4-b3fb-00beff0f6480',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA01278',
 'listing': 'auction',
 'location': 'IT, Ferrara',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 46356,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdb652e9-c41c-5be4-b3fb-00beff0f6480/bdb652e9-c41c-5be4-b3fb-00beff0f6480_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_107bd98e04f0cef9fb18fb9bbb496045.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdb652e9-c41c-5be4-b3fb-00beff0f6480/bdb652e9-c41c-5be4-b3fb-00beff0f6480_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_94fa9cdf89bd6d88379e448239c0d310.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdb652e9-c41c-5be4-b3fb-00beff0f6480/bdb652e9-c41c-5be4-b3fb-00beff0f6480_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_604cb0b3427e121e88f4ddb1b63b04f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdb652e9-c41c-5be4-b3fb-00beff0f6480/bdb652e9-c41c-5be4-b3fb-00beff0f6480_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_d0d1c5b858b8897c4c9279fed3993acd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdb652e9-c41c-5be4-b3fb-00beff0f6480/bdb652e9-c41c-5be4-b3fb-00beff0f6480_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59235,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_8589214ceb3fd895cf6a5321af4a8bf2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdb652e9-c41c-5be4-b3fb-00beff0f6480/bdb652e9-c41c-5be4-b3fb-00beff0f6480_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_502f5de918a01da65bbe0102b49acfce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdb652e9-c41c-5be4-b3fb-00beff0f6480/bdb652e9-c41c-5be4-b3fb-00beff0f6480_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48942,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_ae8f3e3b24480b9fe2557ef0de08005c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdb652e9-c41c-5be4-b3fb-00beff0f6480/bdb652e9-c41c-5be4-b3fb-00beff0f6480_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_e80d0e411cc62b87cfc63a4063e9b195.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdb652e9-c41c-5be4-b3fb-00beff0f6480/bdb652e9-c41c-5be4-b3fb-00beff0f6480_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_28acfe84ed01192d707562d3ba9ea8dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdb652e9-c41c-5be4-b3fb-00beff0f6480/bdb652e9-c41c-5be4-b3fb-00beff0f6480_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/fa/9cfacb2691ab5d058276a609b31b57fc/pa/BA01278_99677d6bbd24061fc5bcbe2e24e24975.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-12-02',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA01278%27 HTTP/1.1" 200 None
2026-03-28 12:06:08 [auto1.it] INFO: Saving data for BA01278: {'created_time': 1774699568.83016, 'last_price_update_time': 1774699568.830172, 'auction_closing_time': 1774885690.0}
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BA01278') HTTP/1.1" 204 0
2026-03-28 12:06:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 859efc99-201c-5de7-8656-ad1f0f754ed1 with identifier: JZ77925
2026-03-28 12:06:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 859efc99-201c-5de7-8656-ad1f0f754ed1 with identifier: JZ77925
2026-03-28 12:06:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 859efc99-201c-5de7-8656-ad1f0f754ed1 with identifier: JZ77925 to the API
2026-03-28 12:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_5a67b0138d7a7e977c4144dc92160178.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:39:04Z',
 'fuel_type': 'petrol',
 'id': '859efc99-201c-5de7-8656-ad1f0f754ed1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ77925',
 'listing': 'auction',
 'location': 'IT, Modugno',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 212530,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_859efc99-201c-5de7-8656-ad1f0f754ed1/859efc99-201c-5de7-8656-ad1f0f754ed1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_3ddee0b3ab03e0d3b77475bcf246d306.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_859efc99-201c-5de7-8656-ad1f0f754ed1/859efc99-201c-5de7-8656-ad1f0f754ed1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_5a67b0138d7a7e977c4144dc92160178.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_859efc99-201c-5de7-8656-ad1f0f754ed1/859efc99-201c-5de7-8656-ad1f0f754ed1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_cf623962b3a8176db34c0294cad36087.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_859efc99-201c-5de7-8656-ad1f0f754ed1/859efc99-201c-5de7-8656-ad1f0f754ed1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_7393f9e9b7b962f56dcfcdfe166ed99e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_859efc99-201c-5de7-8656-ad1f0f754ed1/859efc99-201c-5de7-8656-ad1f0f754ed1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_2e3ba74afcb31722324afb6bf378501b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_859efc99-201c-5de7-8656-ad1f0f754ed1/859efc99-201c-5de7-8656-ad1f0f754ed1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_d22b21fb5e8acac70f76e6bb5d8bbc20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_859efc99-201c-5de7-8656-ad1f0f754ed1/859efc99-201c-5de7-8656-ad1f0f754ed1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50448,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_aa84707cec362caf918ff28a17b9abae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_859efc99-201c-5de7-8656-ad1f0f754ed1/859efc99-201c-5de7-8656-ad1f0f754ed1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69609,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_6f3d4c38aef4e0ef997ae4923437d58a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_859efc99-201c-5de7-8656-ad1f0f754ed1/859efc99-201c-5de7-8656-ad1f0f754ed1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_e2979153e6b048e8bf7048cdb71ab788.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_859efc99-201c-5de7-8656-ad1f0f754ed1/859efc99-201c-5de7-8656-ad1f0f754ed1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ec/e8ecdd33035e6f840eec212bb1d7e560/pa/JZ77925_e34494b98c2898a221b80ed0c30a02d9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-02-02',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.6 Turbo Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2015}
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ77925%27 HTTP/1.1" 200 None
2026-03-28 12:06:09 [auto1.it] INFO: Saving data for JZ77925: {'created_time': 1774699569.238944, 'last_price_update_time': 1774699569.238953, 'auction_closing_time': 1774885144.0}
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JZ77925') HTTP/1.1" 204 0
2026-03-28 12:06:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0d9c297f-ad9d-5faf-b514-c63740f12274 with identifier: WA05506
2026-03-28 12:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0d9c297f-ad9d-5faf-b514-c63740f12274 with identifier: WA05506
2026-03-28 12:06:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0d9c297f-ad9d-5faf-b514-c63740f12274 with identifier: WA05506 to the API
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_0e9586516a5b94ffc889ccc8a9c4473e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:33:12Z',
 'fuel_type': 'petrol',
 'id': '0d9c297f-ad9d-5faf-b514-c63740f12274',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA05506',
 'listing': 'auction',
 'location': 'IT, Abbiategrasso',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 154433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d9c297f-ad9d-5faf-b514-c63740f12274/0d9c297f-ad9d-5faf-b514-c63740f12274_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_0e9586516a5b94ffc889ccc8a9c4473e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d9c297f-ad9d-5faf-b514-c63740f12274/0d9c297f-ad9d-5faf-b514-c63740f12274_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_f47652049c8d37cf37977d1a9ec0bb25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d9c297f-ad9d-5faf-b514-c63740f12274/0d9c297f-ad9d-5faf-b514-c63740f12274_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_fa941e6bda5226faae6600b8ee0dd592.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d9c297f-ad9d-5faf-b514-c63740f12274/0d9c297f-ad9d-5faf-b514-c63740f12274_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87560,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_28a5ebbd5f6f47c8bb5fa8d0b887c798.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d9c297f-ad9d-5faf-b514-c63740f12274/0d9c297f-ad9d-5faf-b514-c63740f12274_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_e803b5b959e84cc2d317653a0a5a1a97.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-11-25',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive passion',
 'year': 2008}
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA05506%27 HTTP/1.1" 200 None
2026-03-28 12:06:09 [auto1.it] INFO: Saving data for WA05506: {'created_time': 1774699569.588945, 'last_price_update_time': 1774699569.588955, 'auction_closing_time': 1774884792.0}
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WA05506') HTTP/1.1" 204 0
2026-03-28 12:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RC42052> (referer: https://www.auto1.com/v1/car-details-view/RC42052/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UN20093> (referer: https://www.auto1.com/v1/car-details-view/UN20093/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DU34377/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bce8d110>
2026-03-28 12:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_162bacd6-cf45-5c7b-b8fb-2349c890dad3/162bacd6-cf45-5c7b-b8fb-2349c890dad3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Ff4%252F69f426301771797af1096b611f3f27b5%252Fpa%252FZH08694_463922be767041f935601ec2432d9600.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_463922be767041f935601ec2432d9600.jpg saved to cache
2026-03-28 12:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 162bacd6-cf45-5c7b-b8fb-2349c890dad3
2026-03-28 12:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3ab810>
2026-03-28 12:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_162bacd6-cf45-5c7b-b8fb-2349c890dad3/162bacd6-cf45-5c7b-b8fb-2349c890dad3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Ff4%252F69f426301771797af1096b611f3f27b5%252Fpa%252FZH08694_b9ab3771da12e8806050cdb07328a2a1.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_b9ab3771da12e8806050cdb07328a2a1.jpg saved to cache
2026-03-28 12:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 162bacd6-cf45-5c7b-b8fb-2349c890dad3
2026-03-28 12:06:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 162bacd6-cf45-5c7b-b8fb-2349c890dad3, skipping ID generation
2026-03-28 12:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 162bacd6-cf45-5c7b-b8fb-2349c890dad3 with scrape type 1
2026-03-28 12:06:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 162bacd6-cf45-5c7b-b8fb-2349c890dad3 sending to next pipeline
2026-03-28 12:06:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 162bacd6-cf45-5c7b-b8fb-2349c890dad3, identifier: ZH08694
2026-03-28 12:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_0cfd03321938e2bcc2068946343a3b11.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 162bacd6-cf45-5c7b-b8fb-2349c890dad3 with identifier: ZH08694
2026-03-28 12:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 162bacd6-cf45-5c7b-b8fb-2349c890dad3 with identifier: ZH08694
2026-03-28 12:06:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 162bacd6-cf45-5c7b-b8fb-2349c890dad3 with identifier: ZH08694 to the API
2026-03-28 12:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_b9ab3771da12e8806050cdb07328a2a1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 107,
 'expiration_date': '2026-03-30T15:07:08Z',
 'fuel_type': 'diesel',
 'id': '162bacd6-cf45-5c7b-b8fb-2349c890dad3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH08694',
 'listing': 'auction',
 'location': 'IT, Cesano Maderno',
 'make': 'Dacia',
 'model': 'Lodgy',
 'odometer': 121243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162bacd6-cf45-5c7b-b8fb-2349c890dad3/162bacd6-cf45-5c7b-b8fb-2349c890dad3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_af43cfb4f093b920c90ec6e3a3dc94a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162bacd6-cf45-5c7b-b8fb-2349c890dad3/162bacd6-cf45-5c7b-b8fb-2349c890dad3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_00a5d09bb5aa00473e91feaeed2bf604.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162bacd6-cf45-5c7b-b8fb-2349c890dad3/162bacd6-cf45-5c7b-b8fb-2349c890dad3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_b9ab3771da12e8806050cdb07328a2a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162bacd6-cf45-5c7b-b8fb-2349c890dad3/162bacd6-cf45-5c7b-b8fb-2349c890dad3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47184,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_463922be767041f935601ec2432d9600.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162bacd6-cf45-5c7b-b8fb-2349c890dad3/162bacd6-cf45-5c7b-b8fb-2349c890dad3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58639,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_2430d9ed86818c72fa9251bc336f9838.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162bacd6-cf45-5c7b-b8fb-2349c890dad3/162bacd6-cf45-5c7b-b8fb-2349c890dad3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_ab49e9ecfd1762f502fbf4863cce5f61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162bacd6-cf45-5c7b-b8fb-2349c890dad3/162bacd6-cf45-5c7b-b8fb-2349c890dad3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_bec26742175c8efa21b32ea532de3e6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162bacd6-cf45-5c7b-b8fb-2349c890dad3/162bacd6-cf45-5c7b-b8fb-2349c890dad3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_e6d70a682a47f14d067417ebde06dfbb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162bacd6-cf45-5c7b-b8fb-2349c890dad3/162bacd6-cf45-5c7b-b8fb-2349c890dad3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70118,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_e8bd537a10ed01b255b9f4f42f64b6b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162bacd6-cf45-5c7b-b8fb-2349c890dad3/162bacd6-cf45-5c7b-b8fb-2349c890dad3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/f4/69f426301771797af1096b611f3f27b5/pa/ZH08694_08ad9f0fe4962df8e068c27cb8f3248c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Lodgy 1.5 dCi Diesel SL Trotamundos',
 'transmission': 'manual',
 'trim': 'SL Trotamundos',
 'year': 2017}
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH08694%27 HTTP/1.1" 200 None
2026-03-28 12:06:10 [auto1.it] INFO: Saving data for ZH08694: {'created_time': 1774699570.135768, 'last_price_update_time': 1774699570.135781, 'auction_closing_time': 1774883228.0}
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZH08694') HTTP/1.1" 204 0
2026-03-28 12:06:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d847a549-bef9-5b48-b0af-ad4a5c54f2d2 with identifier: RC42052
2026-03-28 12:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d847a549-bef9-5b48-b0af-ad4a5c54f2d2 with scrape type 1
2026-03-28 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d847a549-bef9-5b48-b0af-ad4a5c54f2d2
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F49%252Ff649cae8d0e344c8b0fdfe07053833a3%252Fpa%252FRC42052_136f9006f7d8d483ebbe4985f52adf40.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_136f9006f7d8d483ebbe4985f52adf40.jpg not downloaded yet
2026-03-28 12:06:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b7d8151-7119-57f9-be13-cd5ecb373c85 with identifier: UN20093
2026-03-28 12:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b7d8151-7119-57f9-be13-cd5ecb373c85 with scrape type 1
2026-03-28 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1b7d8151-7119-57f9-be13-cd5ecb373c85
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fc8%252F1ac8376a89c10f343dcbcf68449f935a%252Fpa%252FUN20093_e85fbb366a8e6ddf8a7cfbd731211bba.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_e85fbb366a8e6ddf8a7cfbd731211bba.jpg not downloaded yet
2026-03-28 12:06:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc4dd7d0>
2026-03-28 12:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f74791e-15fd-549d-9408-0209871b4e0e/3f74791e-15fd-549d-9408-0209871b4e0e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc8%252F8cc8c9d9675ae598906f9ffed59399aa%252Fpa%252FPW47751_0cfd03321938e2bcc2068946343a3b11.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_0cfd03321938e2bcc2068946343a3b11.jpg saved to cache
2026-03-28 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3f74791e-15fd-549d-9408-0209871b4e0e
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F49%252Ff649cae8d0e344c8b0fdfe07053833a3%252Fpa%252FRC42052_ef052084c24b047fadbb560fcb3d915f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_ef052084c24b047fadbb560fcb3d915f.jpg not downloaded yet
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fc8%252F1ac8376a89c10f343dcbcf68449f935a%252Fpa%252FUN20093_a1807ccc40998d899a08ca143b216955.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_a1807ccc40998d899a08ca143b216955.jpg not downloaded yet
2026-03-28 12:06:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FR55532> (referer: https://www.auto1.com/v1/car-details-view/FR55532/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_7a79ef499d476e8d01a045a33bd0ff7d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_b9f56c368e0b1d6601ded513b3073a65.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F49%252Ff649cae8d0e344c8b0fdfe07053833a3%252Fpa%252FRC42052_21429542c8c654d41bf5ffd49e33b880.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_21429542c8c654d41bf5ffd49e33b880.jpg not downloaded yet
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fc8%252F1ac8376a89c10f343dcbcf68449f935a%252Fpa%252FUN20093_8ac82532bfcd070d1b35bc8a1d295394.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_8ac82532bfcd070d1b35bc8a1d295394.jpg not downloaded yet
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F49%252Ff649cae8d0e344c8b0fdfe07053833a3%252Fpa%252FRC42052_b71cf290e69af22289d9e819b42d1d3d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_b71cf290e69af22289d9e819b42d1d3d.jpg not downloaded yet
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fc8%252F1ac8376a89c10f343dcbcf68449f935a%252Fpa%252FUN20093_885e75c9f66a9559daa8866001a53ba9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_885e75c9f66a9559daa8866001a53ba9.jpg not downloaded yet
2026-03-28 12:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZU99068/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_e85fbb366a8e6ddf8a7cfbd731211bba.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F49%252Ff649cae8d0e344c8b0fdfe07053833a3%252Fpa%252FRC42052_b8639e974d723aaf28e2de7becef4c25.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_b8639e974d723aaf28e2de7becef4c25.jpg not downloaded yet
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fc8%252F1ac8376a89c10f343dcbcf68449f935a%252Fpa%252FUN20093_62006c306f6c60bbfabad49d002d4286.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_62006c306f6c60bbfabad49d002d4286.jpg not downloaded yet
2026-03-28 12:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_136f9006f7d8d483ebbe4985f52adf40.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F49%252Ff649cae8d0e344c8b0fdfe07053833a3%252Fpa%252FRC42052_ab184af7f3e5dcf18dd518f7da901c91.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_ab184af7f3e5dcf18dd518f7da901c91.jpg not downloaded yet
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fc8%252F1ac8376a89c10f343dcbcf68449f935a%252Fpa%252FUN20093_2ac729a3a32612a135d1f573656cb682.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_2ac729a3a32612a135d1f573656cb682.jpg not downloaded yet
2026-03-28 12:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_146c9ea107acb7208d1f41a91ed0707e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WE07120/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:10 [auto1.it] INFO: Channel: 24h | Page: 4 | totalHits: 3673 | hits on page: 40
2026-03-28 12:06:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1540861-55d8-5622-83cc-65661a4f82a9 with identifier: FR55532
2026-03-28 12:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1540861-55d8-5622-83cc-65661a4f82a9 with scrape type 1
2026-03-28 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f1540861-55d8-5622-83cc-65661a4f82a9
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ffa%252Fb0fa5fe76c0edb84d6f2dd581689e2ef%252Fpa%252FFR55532_e41cc6d207d7f4045ca21fc0c5075312.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_e41cc6d207d7f4045ca21fc0c5075312.jpg not downloaded yet
2026-03-28 12:06:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3ca3d0>
2026-03-28 12:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f74791e-15fd-549d-9408-0209871b4e0e/3f74791e-15fd-549d-9408-0209871b4e0e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc8%252F8cc8c9d9675ae598906f9ffed59399aa%252Fpa%252FPW47751_7a79ef499d476e8d01a045a33bd0ff7d.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_7a79ef499d476e8d01a045a33bd0ff7d.jpg saved to cache
2026-03-28 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3f74791e-15fd-549d-9408-0209871b4e0e
2026-03-28 12:06:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3dc8d0>
2026-03-28 12:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f74791e-15fd-549d-9408-0209871b4e0e/3f74791e-15fd-549d-9408-0209871b4e0e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc8%252F8cc8c9d9675ae598906f9ffed59399aa%252Fpa%252FPW47751_b9f56c368e0b1d6601ded513b3073a65.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_b9f56c368e0b1d6601ded513b3073a65.jpg saved to cache
2026-03-28 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3f74791e-15fd-549d-9408-0209871b4e0e
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F49%252Ff649cae8d0e344c8b0fdfe07053833a3%252Fpa%252FRC42052_11df6cc8714bde5dbceec8d82e586d45.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_11df6cc8714bde5dbceec8d82e586d45.jpg not downloaded yet
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fc8%252F1ac8376a89c10f343dcbcf68449f935a%252Fpa%252FUN20093_cba61a1dfcffac6746a56c5c2935cb6f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_cba61a1dfcffac6746a56c5c2935cb6f.jpg not downloaded yet
2026-03-28 12:06:10 [auto1.it] INFO: Found listing with ID: NW63690
2026-03-28 12:06:10 [auto1.it] INFO: Found listing with ID: CR10860
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR10860%27 HTTP/1.1" 200 None
2026-03-28 12:06:10 [auto1.it] INFO: Scrape type for CR10860: 1
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ffa%252Fb0fa5fe76c0edb84d6f2dd581689e2ef%252Fpa%252FFR55532_da657a216fca8dd2d446364d6ae99d7b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_da657a216fca8dd2d446364d6ae99d7b.jpg not downloaded yet
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F49%252Ff649cae8d0e344c8b0fdfe07053833a3%252Fpa%252FRC42052_32ae141e0b6454242b5bc4a6753a57d5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_32ae141e0b6454242b5bc4a6753a57d5.jpg not downloaded yet
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fc8%252F1ac8376a89c10f343dcbcf68449f935a%252Fpa%252FUN20093_af7feaf571dfd46f4597362eb02293df.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_af7feaf571dfd46f4597362eb02293df.jpg not downloaded yet
2026-03-28 12:06:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:10 [auto1.it] INFO: Found listing with ID: PX02634
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PX02634%27 HTTP/1.1" 200 None
2026-03-28 12:06:10 [auto1.it] INFO: Scrape type for PX02634: 1
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ffa%252Fb0fa5fe76c0edb84d6f2dd581689e2ef%252Fpa%252FFR55532_0f7203bf7ca9d7efee9d4ee5ae33baba.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_0f7203bf7ca9d7efee9d4ee5ae33baba.jpg not downloaded yet
2026-03-28 12:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc55b690>
2026-03-28 12:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b7d8151-7119-57f9-be13-cd5ecb373c85/1b7d8151-7119-57f9-be13-cd5ecb373c85_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fc8%252F1ac8376a89c10f343dcbcf68449f935a%252Fpa%252FUN20093_e85fbb366a8e6ddf8a7cfbd731211bba.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_e85fbb366a8e6ddf8a7cfbd731211bba.jpg saved to cache
2026-03-28 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b7d8151-7119-57f9-be13-cd5ecb373c85
2026-03-28 12:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bceb3d50>
2026-03-28 12:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d847a549-bef9-5b48-b0af-ad4a5c54f2d2/d847a549-bef9-5b48-b0af-ad4a5c54f2d2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F49%252Ff649cae8d0e344c8b0fdfe07053833a3%252Fpa%252FRC42052_136f9006f7d8d483ebbe4985f52adf40.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_136f9006f7d8d483ebbe4985f52adf40.jpg saved to cache
2026-03-28 12:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d847a549-bef9-5b48-b0af-ad4a5c54f2d2
2026-03-28 12:06:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bceb1310>
2026-03-28 12:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f74791e-15fd-549d-9408-0209871b4e0e/3f74791e-15fd-549d-9408-0209871b4e0e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc8%252F8cc8c9d9675ae598906f9ffed59399aa%252Fpa%252FPW47751_146c9ea107acb7208d1f41a91ed0707e.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_146c9ea107acb7208d1f41a91ed0707e.jpg saved to cache
2026-03-28 12:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3f74791e-15fd-549d-9408-0209871b4e0e
2026-03-28 12:06:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f74791e-15fd-549d-9408-0209871b4e0e, skipping ID generation
2026-03-28 12:06:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f74791e-15fd-549d-9408-0209871b4e0e with scrape type 1
2026-03-28 12:06:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f74791e-15fd-549d-9408-0209871b4e0e sending to next pipeline
2026-03-28 12:06:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3f74791e-15fd-549d-9408-0209871b4e0e, identifier: PW47751
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F49%252Ff649cae8d0e344c8b0fdfe07053833a3%252Fpa%252FRC42052_cecad94d2baf64cc5233136646ead31b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_cecad94d2baf64cc5233136646ead31b.jpg not downloaded yet
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fc8%252F1ac8376a89c10f343dcbcf68449f935a%252Fpa%252FUN20093_95f17ff18251f808989bf5657d8cf257.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_95f17ff18251f808989bf5657d8cf257.jpg not downloaded yet
2026-03-28 12:06:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3f74791e-15fd-549d-9408-0209871b4e0e with identifier: PW47751
2026-03-28 12:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3f74791e-15fd-549d-9408-0209871b4e0e with identifier: PW47751
2026-03-28 12:06:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3f74791e-15fd-549d-9408-0209871b4e0e with identifier: PW47751 to the API
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_146c9ea107acb7208d1f41a91ed0707e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.2L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:35:39Z',
 'fuel_type': 'diesel',
 'id': '3f74791e-15fd-549d-9408-0209871b4e0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW47751',
 'listing': 'auction',
 'location': 'IT, Fiumicino',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 119201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f74791e-15fd-549d-9408-0209871b4e0e/3f74791e-15fd-549d-9408-0209871b4e0e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_84663fc56210899a5167b9b0ff2ef2c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f74791e-15fd-549d-9408-0209871b4e0e/3f74791e-15fd-549d-9408-0209871b4e0e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2578504,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_146c9ea107acb7208d1f41a91ed0707e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f74791e-15fd-549d-9408-0209871b4e0e/3f74791e-15fd-549d-9408-0209871b4e0e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2712823,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_b9f56c368e0b1d6601ded513b3073a65.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f74791e-15fd-549d-9408-0209871b4e0e/3f74791e-15fd-549d-9408-0209871b4e0e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2429256,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_a82a00984cf143231933c7442bdc61d5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f74791e-15fd-549d-9408-0209871b4e0e/3f74791e-15fd-549d-9408-0209871b4e0e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_b2792d58b94a14c5fe949384603a3818.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f74791e-15fd-549d-9408-0209871b4e0e/3f74791e-15fd-549d-9408-0209871b4e0e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_fce1d89b1c75c290f36d438914a9eda5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f74791e-15fd-549d-9408-0209871b4e0e/3f74791e-15fd-549d-9408-0209871b4e0e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2656171,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_2bb92280e43c7bc3f1e094e1892f9160.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f74791e-15fd-549d-9408-0209871b4e0e/3f74791e-15fd-549d-9408-0209871b4e0e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_b0c21628723b0b9b79528e9fdc24ea62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f74791e-15fd-549d-9408-0209871b4e0e/3f74791e-15fd-549d-9408-0209871b4e0e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2396160,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_0cfd03321938e2bcc2068946343a3b11.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f74791e-15fd-549d-9408-0209871b4e0e/3f74791e-15fd-549d-9408-0209871b4e0e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2882815,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/c8/8cc8c9d9675ae598906f9ffed59399aa/pa/PW47751_7a79ef499d476e8d01a045a33bd0ff7d.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500L 1.3 M-Jet City Cross',
 'transmission': 'manual',
 'trim': 'City Cross',
 'year': 2019}
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW47751%27 HTTP/1.1" 200 None
2026-03-28 12:06:11 [auto1.it] INFO: Saving data for PW47751: {'created_time': 1774699571.671068, 'last_price_update_time': 1774699571.671082, 'auction_closing_time': 1774884939.0}
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PW47751') HTTP/1.1" 204 0
2026-03-28 12:06:11 [auto1.it] INFO: Found listing with ID: RZ14942
2026-03-28 12:06:11 [auto1.it] INFO: Found listing with ID: NE68522
2026-03-28 12:06:11 [auto1.it] INFO: Found listing with ID: HB76167
2026-03-28 12:06:11 [auto1.it] INFO: Found listing with ID: LW42205
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW42205%27 HTTP/1.1" 200 None
2026-03-28 12:06:11 [auto1.it] INFO: Scrape type for LW42205: 1
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ffa%252Fb0fa5fe76c0edb84d6f2dd581689e2ef%252Fpa%252FFR55532_c71be92bb040e08ef01ae7aeaa494af3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_c71be92bb040e08ef01ae7aeaa494af3.jpg not downloaded yet
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F49%252Ff649cae8d0e344c8b0fdfe07053833a3%252Fpa%252FRC42052_4f188a4165e25794cb93aea152e0f819.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_4f188a4165e25794cb93aea152e0f819.jpg not downloaded yet
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fc8%252F1ac8376a89c10f343dcbcf68449f935a%252Fpa%252FUN20093_a0ea3ca0fbc798fe71c60624414ff3de.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_a0ea3ca0fbc798fe71c60624414ff3de.jpg not downloaded yet
2026-03-28 12:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_2ac729a3a32612a135d1f573656cb682.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_ab184af7f3e5dcf18dd518f7da901c91.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:11 [auto1.it] INFO: Found listing with ID: YU39946
2026-03-28 12:06:11 [auto1.it] INFO: Found listing with ID: JX99167
2026-03-28 12:06:11 [auto1.it] INFO: Found listing with ID: PR01158
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR01158%27 HTTP/1.1" 200 None
2026-03-28 12:06:11 [auto1.it] INFO: Scrape type for PR01158: 1
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ffa%252Fb0fa5fe76c0edb84d6f2dd581689e2ef%252Fpa%252FFR55532_d556588c082306a67afde73ae277543f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_d556588c082306a67afde73ae277543f.jpg not downloaded yet
2026-03-28 12:06:11 [auto1.it] INFO: Found listing with ID: PB77964
2026-03-28 12:06:11 [auto1.it] INFO: Found listing with ID: LU04143
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU04143%27 HTTP/1.1" 200 None
2026-03-28 12:06:11 [auto1.it] INFO: Scrape type for LU04143: 1
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ffa%252Fb0fa5fe76c0edb84d6f2dd581689e2ef%252Fpa%252FFR55532_a02ecd1c9a5f422d9ca298e925d969bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_a02ecd1c9a5f422d9ca298e925d969bc.jpg not downloaded yet
2026-03-28 12:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_d8aa294b92f8d6d68b59421d9a89fa88.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:11 [auto1.it] INFO: Found listing with ID: VX06371
2026-03-28 12:06:11 [auto1.it] INFO: Found listing with ID: XU75020
2026-03-28 12:06:11 [auto1.it] INFO: Found listing with ID: RT78827
2026-03-28 12:06:11 [auto1.it] INFO: Found listing with ID: ZX02617
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX02617%27 HTTP/1.1" 200 None
2026-03-28 12:06:11 [auto1.it] INFO: Scrape type for ZX02617: 1
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ffa%252Fb0fa5fe76c0edb84d6f2dd581689e2ef%252Fpa%252FFR55532_e3fad41716fb4922e3b7479ab0743010.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_e3fad41716fb4922e3b7479ab0743010.jpg not downloaded yet
2026-03-28 12:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_2f2c7d584cf17605bb91ed77812908b7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:11 [auto1.it] INFO: Found listing with ID: GF04401
2026-03-28 12:06:11 [auto1.it] INFO: Found listing with ID: LF71839
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LF71839%27 HTTP/1.1" 200 None
2026-03-28 12:06:11 [auto1.it] INFO: Scrape type for LF71839: 1
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ffa%252Fb0fa5fe76c0edb84d6f2dd581689e2ef%252Fpa%252FFR55532_28a33722975842514a2fea117fb6139f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_28a33722975842514a2fea117fb6139f.jpg not downloaded yet
2026-03-28 12:06:11 [auto1.it] INFO: Found listing with ID: KV81214
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KV81214%27 HTTP/1.1" 200 None
2026-03-28 12:06:11 [auto1.it] INFO: Scrape type for KV81214: 1
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ffa%252Fb0fa5fe76c0edb84d6f2dd581689e2ef%252Fpa%252FFR55532_8aab7c86657340a03585380cdabf4233.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_8aab7c86657340a03585380cdabf4233.jpg not downloaded yet
2026-03-28 12:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf36610>
2026-03-28 12:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b7d8151-7119-57f9-be13-cd5ecb373c85/1b7d8151-7119-57f9-be13-cd5ecb373c85_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fc8%252F1ac8376a89c10f343dcbcf68449f935a%252Fpa%252FUN20093_2ac729a3a32612a135d1f573656cb682.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_2ac729a3a32612a135d1f573656cb682.jpg saved to cache
2026-03-28 12:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1b7d8151-7119-57f9-be13-cd5ecb373c85
2026-03-28 12:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc64c6d0>
2026-03-28 12:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d847a549-bef9-5b48-b0af-ad4a5c54f2d2/d847a549-bef9-5b48-b0af-ad4a5c54f2d2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F49%252Ff649cae8d0e344c8b0fdfe07053833a3%252Fpa%252FRC42052_ab184af7f3e5dcf18dd518f7da901c91.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_ab184af7f3e5dcf18dd518f7da901c91.jpg saved to cache
2026-03-28 12:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d847a549-bef9-5b48-b0af-ad4a5c54f2d2
2026-03-28 12:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_b71cf290e69af22289d9e819b42d1d3d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_885e75c9f66a9559daa8866001a53ba9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: NZ66288
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: LC50167
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC50167%27 HTTP/1.1" 200 None
2026-03-28 12:06:12 [auto1.it] INFO: Scrape type for LC50167: 1
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ffa%252Fb0fa5fe76c0edb84d6f2dd581689e2ef%252Fpa%252FFR55532_809bd45ab1337a18fb187785b928d366.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_809bd45ab1337a18fb187785b928d366.jpg not downloaded yet
2026-03-28 12:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_8ac82532bfcd070d1b35bc8a1d295394.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5d6990>
2026-03-28 12:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6997b28-256f-5be2-8aee-fa9e98aee5d0/a6997b28-256f-5be2-8aee-fa9e98aee5d0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb2%252Fd8b22aa72b648f588813415a2db8c709%252Fpa%252FCE47539_d8aa294b92f8d6d68b59421d9a89fa88.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_d8aa294b92f8d6d68b59421d9a89fa88.jpg saved to cache
2026-03-28 12:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a6997b28-256f-5be2-8aee-fa9e98aee5d0
2026-03-28 12:06:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a6997b28-256f-5be2-8aee-fa9e98aee5d0, skipping ID generation
2026-03-28 12:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6997b28-256f-5be2-8aee-fa9e98aee5d0 with scrape type 1
2026-03-28 12:06:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a6997b28-256f-5be2-8aee-fa9e98aee5d0 sending to next pipeline
2026-03-28 12:06:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a6997b28-256f-5be2-8aee-fa9e98aee5d0, identifier: CE47539
2026-03-28 12:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_b8639e974d723aaf28e2de7becef4c25.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: RB44165
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: KG10642
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: VU78996
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU78996%27 HTTP/1.1" 200 None
2026-03-28 12:06:12 [auto1.it] INFO: Scrape type for VU78996: 1
2026-03-28 12:06:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a6997b28-256f-5be2-8aee-fa9e98aee5d0 with identifier: CE47539
2026-03-28 12:06:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a6997b28-256f-5be2-8aee-fa9e98aee5d0 with identifier: CE47539
2026-03-28 12:06:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a6997b28-256f-5be2-8aee-fa9e98aee5d0 with identifier: CE47539 to the API
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_d8aa294b92f8d6d68b59421d9a89fa88.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.1L',
 'engine_horse_power': 73,
 'expiration_date': '2026-03-30T15:50:34Z',
 'fuel_type': 'petrol',
 'id': 'a6997b28-256f-5be2-8aee-fa9e98aee5d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE47539',
 'listing': 'auction',
 'location': 'IT, Pavia',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 150658,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6997b28-256f-5be2-8aee-fa9e98aee5d0/a6997b28-256f-5be2-8aee-fa9e98aee5d0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2259979,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_c97c477b6adea3a3accf6b866aaeae5e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6997b28-256f-5be2-8aee-fa9e98aee5d0/a6997b28-256f-5be2-8aee-fa9e98aee5d0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2329193,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_7f1ff564db11bd7d52f8202eeff8e64e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6997b28-256f-5be2-8aee-fa9e98aee5d0/a6997b28-256f-5be2-8aee-fa9e98aee5d0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2314439,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_d8aa294b92f8d6d68b59421d9a89fa88.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6997b28-256f-5be2-8aee-fa9e98aee5d0/a6997b28-256f-5be2-8aee-fa9e98aee5d0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2332069,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_82748b92187dc6cc617b427ba597badd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6997b28-256f-5be2-8aee-fa9e98aee5d0/a6997b28-256f-5be2-8aee-fa9e98aee5d0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51064,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_f0a71c2dd84490fcf49bc23d949a8880.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6997b28-256f-5be2-8aee-fa9e98aee5d0/a6997b28-256f-5be2-8aee-fa9e98aee5d0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2182844,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_9c4b463515498537fd88a1209c2b2b8b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6997b28-256f-5be2-8aee-fa9e98aee5d0/a6997b28-256f-5be2-8aee-fa9e98aee5d0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2218352,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_76c4a835c2909655460649c151300053.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6997b28-256f-5be2-8aee-fa9e98aee5d0/a6997b28-256f-5be2-8aee-fa9e98aee5d0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_b21d79619fc6a50cb194400856a037a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6997b28-256f-5be2-8aee-fa9e98aee5d0/a6997b28-256f-5be2-8aee-fa9e98aee5d0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1998794,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_cadea7fb2ea86dbcd3bcae482d5bfe5c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6997b28-256f-5be2-8aee-fa9e98aee5d0/a6997b28-256f-5be2-8aee-fa9e98aee5d0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2437382,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/b2/d8b22aa72b648f588813415a2db8c709/pa/CE47539_8da97c8bed71724edc100cc23bcf72b7.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-06-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.2 Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2014}
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE47539%27 HTTP/1.1" 200 None
2026-03-28 12:06:12 [auto1.it] INFO: Saving data for CE47539: {'created_time': 1774699572.841006, 'last_price_update_time': 1774699572.841019, 'auction_closing_time': 1774885834.0}
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CE47539') HTTP/1.1" 204 0
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: JC58161
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: NB09244
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: CG41342
2026-03-28 12:06:12 [auto1.it] INFO: Found listing with ID: XC50936
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC50936%27 HTTP/1.1" 200 None
2026-03-28 12:06:12 [auto1.it] INFO: Scrape type for XC50936: 1
2026-03-28 12:06:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc400150>
2026-03-28 12:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_515399f1-c951-5577-88f0-8b40f453c68e/515399f1-c951-5577-88f0-8b40f453c68e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd8%252Faed8d8d55f35b476d34c76ba49929d73%252Fpa%252FCS61296_2f2c7d584cf17605bb91ed77812908b7.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_2f2c7d584cf17605bb91ed77812908b7.jpg saved to cache
2026-03-28 12:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 515399f1-c951-5577-88f0-8b40f453c68e
2026-03-28 12:06:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 515399f1-c951-5577-88f0-8b40f453c68e, skipping ID generation
2026-03-28 12:06:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 515399f1-c951-5577-88f0-8b40f453c68e with scrape type 1
2026-03-28 12:06:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 515399f1-c951-5577-88f0-8b40f453c68e sending to next pipeline
2026-03-28 12:06:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 515399f1-c951-5577-88f0-8b40f453c68e, identifier: CS61296
2026-03-28 12:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf7b290>
2026-03-28 12:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d847a549-bef9-5b48-b0af-ad4a5c54f2d2/d847a549-bef9-5b48-b0af-ad4a5c54f2d2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F49%252Ff649cae8d0e344c8b0fdfe07053833a3%252Fpa%252FRC42052_b71cf290e69af22289d9e819b42d1d3d.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_b71cf290e69af22289d9e819b42d1d3d.jpg saved to cache
2026-03-28 12:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d847a549-bef9-5b48-b0af-ad4a5c54f2d2
2026-03-28 12:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3ffe10>
2026-03-28 12:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b7d8151-7119-57f9-be13-cd5ecb373c85/1b7d8151-7119-57f9-be13-cd5ecb373c85_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fc8%252F1ac8376a89c10f343dcbcf68449f935a%252Fpa%252FUN20093_885e75c9f66a9559daa8866001a53ba9.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_885e75c9f66a9559daa8866001a53ba9.jpg saved to cache
2026-03-28 12:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1b7d8151-7119-57f9-be13-cd5ecb373c85
2026-03-28 12:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfb57d0>
2026-03-28 12:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b7d8151-7119-57f9-be13-cd5ecb373c85/1b7d8151-7119-57f9-be13-cd5ecb373c85_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fc8%252F1ac8376a89c10f343dcbcf68449f935a%252Fpa%252FUN20093_8ac82532bfcd070d1b35bc8a1d295394.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_8ac82532bfcd070d1b35bc8a1d295394.jpg saved to cache
2026-03-28 12:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1b7d8151-7119-57f9-be13-cd5ecb373c85
2026-03-28 12:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_a1807ccc40998d899a08ca143b216955.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_a0ea3ca0fbc798fe71c60624414ff3de.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 515399f1-c951-5577-88f0-8b40f453c68e with identifier: CS61296
2026-03-28 12:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 515399f1-c951-5577-88f0-8b40f453c68e with identifier: CS61296
2026-03-28 12:06:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 515399f1-c951-5577-88f0-8b40f453c68e with identifier: CS61296 to the API
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_2f2c7d584cf17605bb91ed77812908b7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:51:47Z',
 'fuel_type': 'diesel',
 'id': '515399f1-c951-5577-88f0-8b40f453c68e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS61296',
 'listing': 'auction',
 'location': 'IT, Latina',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 126849,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515399f1-c951-5577-88f0-8b40f453c68e/515399f1-c951-5577-88f0-8b40f453c68e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2306294,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_7aa443351fec4078250ec1ae89abdad8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515399f1-c951-5577-88f0-8b40f453c68e/515399f1-c951-5577-88f0-8b40f453c68e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_35de2206471dae647c49544216e2a0f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515399f1-c951-5577-88f0-8b40f453c68e/515399f1-c951-5577-88f0-8b40f453c68e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2339449,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_eb7d90a6d8b77361341be1dca9be0fa5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515399f1-c951-5577-88f0-8b40f453c68e/515399f1-c951-5577-88f0-8b40f453c68e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2436816,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_2f2c7d584cf17605bb91ed77812908b7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515399f1-c951-5577-88f0-8b40f453c68e/515399f1-c951-5577-88f0-8b40f453c68e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_6422c60a83d229c9b64bebe653687334.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515399f1-c951-5577-88f0-8b40f453c68e/515399f1-c951-5577-88f0-8b40f453c68e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_2a7d55d1a1819f43bcb189cba23cc008.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515399f1-c951-5577-88f0-8b40f453c68e/515399f1-c951-5577-88f0-8b40f453c68e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2466320,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_b03c3018e8321e40568d2e673d39d072.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515399f1-c951-5577-88f0-8b40f453c68e/515399f1-c951-5577-88f0-8b40f453c68e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2377738,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_68ea54a5d65790be5b52083fb59d0253.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515399f1-c951-5577-88f0-8b40f453c68e/515399f1-c951-5577-88f0-8b40f453c68e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_e7f8ac0c220c6ca4abe2b61bdf21a39d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_515399f1-c951-5577-88f0-8b40f453c68e/515399f1-c951-5577-88f0-8b40f453c68e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2764117,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/d8/aed8d8d55f35b476d34c76ba49929d73/pa/CS61296_9e768f09ea978b8d8dda12fa3a100742.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota RAV 4 2.0 D-4D Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2015}
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS61296%27 HTTP/1.1" 200 None
2026-03-28 12:06:13 [auto1.it] INFO: Saving data for CS61296: {'created_time': 1774699573.743567, 'last_price_update_time': 1774699573.743577, 'auction_closing_time': 1774885907.0}
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CS61296') HTTP/1.1" 204 0
2026-03-28 12:06:13 [auto1.it] INFO: Found listing with ID: PU47641
2026-03-28 12:06:13 [auto1.it] INFO: Found listing with ID: TV36442
2026-03-28 12:06:13 [auto1.it] INFO: Found listing with ID: YG59194
2026-03-28 12:06:13 [auto1.it] INFO: Found listing with ID: NZ89280
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ89280%27 HTTP/1.1" 200 None
2026-03-28 12:06:13 [auto1.it] INFO: Scrape type for NZ89280: 0
2026-03-28 12:06:13 [auto1.it] INFO: Found listing with ID: DV86201
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV86201%27 HTTP/1.1" 200 None
2026-03-28 12:06:13 [auto1.it] INFO: Scrape type for DV86201: 1
2026-03-28 12:06:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc583ed0>
2026-03-28 12:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d847a549-bef9-5b48-b0af-ad4a5c54f2d2/d847a549-bef9-5b48-b0af-ad4a5c54f2d2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F49%252Ff649cae8d0e344c8b0fdfe07053833a3%252Fpa%252FRC42052_b8639e974d723aaf28e2de7becef4c25.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_b8639e974d723aaf28e2de7becef4c25.jpg saved to cache
2026-03-28 12:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d847a549-bef9-5b48-b0af-ad4a5c54f2d2
2026-03-28 12:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_4f188a4165e25794cb93aea152e0f819.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:13 [auto1.it] INFO: Found listing with ID: MR47105
2026-03-28 12:06:13 [auto1.it] INFO: Found listing with ID: CP63934
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP63934%27 HTTP/1.1" 200 None
2026-03-28 12:06:13 [auto1.it] INFO: Scrape type for CP63934: 1
2026-03-28 12:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_a02ecd1c9a5f422d9ca298e925d969bc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3868d0>
2026-03-28 12:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b7d8151-7119-57f9-be13-cd5ecb373c85/1b7d8151-7119-57f9-be13-cd5ecb373c85_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fc8%252F1ac8376a89c10f343dcbcf68449f935a%252Fpa%252FUN20093_a1807ccc40998d899a08ca143b216955.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_a1807ccc40998d899a08ca143b216955.jpg saved to cache
2026-03-28 12:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1b7d8151-7119-57f9-be13-cd5ecb373c85
2026-03-28 12:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfb52d0>
2026-03-28 12:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b7d8151-7119-57f9-be13-cd5ecb373c85/1b7d8151-7119-57f9-be13-cd5ecb373c85_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fc8%252F1ac8376a89c10f343dcbcf68449f935a%252Fpa%252FUN20093_a0ea3ca0fbc798fe71c60624414ff3de.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_a0ea3ca0fbc798fe71c60624414ff3de.jpg saved to cache
2026-03-28 12:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1b7d8151-7119-57f9-be13-cd5ecb373c85
2026-03-28 12:06:14 [auto1.it] INFO: Channel: 24h | Page: 5 | totalHits: 3673 | hits on page: 40
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: WA70865
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: ZB75356
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: SM49398
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM49398%27 HTTP/1.1" 200 None
2026-03-28 12:06:14 [auto1.it] INFO: Scrape type for SM49398: 1
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: DE18860
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE18860%27 HTTP/1.1" 200 None
2026-03-28 12:06:14 [auto1.it] INFO: Scrape type for DE18860: 1
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: ND99251
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ND99251%27 HTTP/1.1" 200 None
2026-03-28 12:06:14 [auto1.it] INFO: Scrape type for ND99251: 2
2026-03-28 12:06:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6cc93ac-99f6-53e5-81b5-a4ab0dc95a5f with identifier: ND99251
2026-03-28 12:06:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6cc93ac-99f6-53e5-81b5-a4ab0dc95a5f with scrape type 2
2026-03-28 12:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6cc93ac-99f6-53e5-81b5-a4ab0dc95a5f with scrape type 2
2026-03-28 12:06:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a6cc93ac-99f6-53e5-81b5-a4ab0dc95a5f, identifier: ND99251
2026-03-28 12:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfd5810>
2026-03-28 12:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d847a549-bef9-5b48-b0af-ad4a5c54f2d2/d847a549-bef9-5b48-b0af-ad4a5c54f2d2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F49%252Ff649cae8d0e344c8b0fdfe07053833a3%252Fpa%252FRC42052_4f188a4165e25794cb93aea152e0f819.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_4f188a4165e25794cb93aea152e0f819.jpg saved to cache
2026-03-28 12:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d847a549-bef9-5b48-b0af-ad4a5c54f2d2
2026-03-28 12:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_8aab7c86657340a03585380cdabf4233.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a6cc93ac-99f6-53e5-81b5-a4ab0dc95a5f with identifier: ND99251
2026-03-28 12:06:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a6cc93ac-99f6-53e5-81b5-a4ab0dc95a5f with identifier: ND99251
2026-03-28 12:06:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a6cc93ac-99f6-53e5-81b5-a4ab0dc95a5f with identifier: ND99251 to the API
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:49:36Z',
 'fuel_type': 'diesel',
 'id': 'a6cc93ac-99f6-53e5-81b5-a4ab0dc95a5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND99251',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 167259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-02',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2014}
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ND99251%27 HTTP/1.1" 200 None
2026-03-28 12:06:14 [auto1.it] INFO: Saving data for ND99251: {'auction_closing_time': 1774885776.0, 'created_time': 1774343168.357267, 'last_price_update_time': 1774699574.751842}
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ND99251') HTTP/1.1" 204 0
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: BM48711
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: NH24051
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH24051%27 HTTP/1.1" 200 None
2026-03-28 12:06:14 [auto1.it] INFO: Scrape type for NH24051: 1
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: RE64067
2026-03-28 12:06:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bf1bff90>
2026-03-28 12:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1540861-55d8-5622-83cc-65661a4f82a9/f1540861-55d8-5622-83cc-65661a4f82a9_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ffa%252Fb0fa5fe76c0edb84d6f2dd581689e2ef%252Fpa%252FFR55532_a02ecd1c9a5f422d9ca298e925d969bc.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_a02ecd1c9a5f422d9ca298e925d969bc.jpg saved to cache
2026-03-28 12:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f1540861-55d8-5622-83cc-65661a4f82a9
2026-03-28 12:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_809bd45ab1337a18fb187785b928d366.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_28a33722975842514a2fea117fb6139f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: LU93439
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU93439%27 HTTP/1.1" 200 None
2026-03-28 12:06:14 [auto1.it] INFO: Scrape type for LU93439: 1
2026-03-28 12:06:14 [auto1.it] INFO: Found listing with ID: GC10643
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC10643%27 HTTP/1.1" 200 None
2026-03-28 12:06:14 [auto1.it] INFO: Scrape type for GC10643: 1
2026-03-28 12:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc58c190>
2026-03-28 12:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1540861-55d8-5622-83cc-65661a4f82a9/f1540861-55d8-5622-83cc-65661a4f82a9_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ffa%252Fb0fa5fe76c0edb84d6f2dd581689e2ef%252Fpa%252FFR55532_8aab7c86657340a03585380cdabf4233.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_8aab7c86657340a03585380cdabf4233.jpg saved to cache
2026-03-28 12:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f1540861-55d8-5622-83cc-65661a4f82a9
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: SZ93699
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SZ93699%27 HTTP/1.1" 200 None
2026-03-28 12:06:15 [auto1.it] INFO: Scrape type for SZ93699: 1
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: HD89174
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: LL57465
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: SD35651
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: VJ26511
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ26511%27 HTTP/1.1" 200 None
2026-03-28 12:06:15 [auto1.it] INFO: Scrape type for VJ26511: 1
2026-03-28 12:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_cba61a1dfcffac6746a56c5c2935cb6f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: UM38141
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM38141%27 HTTP/1.1" 200 None
2026-03-28 12:06:15 [auto1.it] INFO: Scrape type for UM38141: 1
2026-03-28 12:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd03fdd0>
2026-03-28 12:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1540861-55d8-5622-83cc-65661a4f82a9/f1540861-55d8-5622-83cc-65661a4f82a9_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ffa%252Fb0fa5fe76c0edb84d6f2dd581689e2ef%252Fpa%252FFR55532_809bd45ab1337a18fb187785b928d366.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_809bd45ab1337a18fb187785b928d366.jpg saved to cache
2026-03-28 12:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f1540861-55d8-5622-83cc-65661a4f82a9
2026-03-28 12:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd0e8750>
2026-03-28 12:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1540861-55d8-5622-83cc-65661a4f82a9/f1540861-55d8-5622-83cc-65661a4f82a9_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ffa%252Fb0fa5fe76c0edb84d6f2dd581689e2ef%252Fpa%252FFR55532_28a33722975842514a2fea117fb6139f.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_28a33722975842514a2fea117fb6139f.jpg saved to cache
2026-03-28 12:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f1540861-55d8-5622-83cc-65661a4f82a9
2026-03-28 12:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_62006c306f6c60bbfabad49d002d4286.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_e3fad41716fb4922e3b7479ab0743010.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: XE84016
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: LD34697
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD34697%27 HTTP/1.1" 200 None
2026-03-28 12:06:15 [auto1.it] INFO: Scrape type for LD34697: 1
2026-03-28 12:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_e41cc6d207d7f4045ca21fc0c5075312.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: NN91424
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: JP07987
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: ZM57231
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: KG93031
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: PK33610
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK33610%27 HTTP/1.1" 200 None
2026-03-28 12:06:15 [auto1.it] INFO: Scrape type for PK33610: 1
2026-03-28 12:06:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd156510>
2026-03-28 12:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b7d8151-7119-57f9-be13-cd5ecb373c85/1b7d8151-7119-57f9-be13-cd5ecb373c85_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fc8%252F1ac8376a89c10f343dcbcf68449f935a%252Fpa%252FUN20093_cba61a1dfcffac6746a56c5c2935cb6f.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_cba61a1dfcffac6746a56c5c2935cb6f.jpg saved to cache
2026-03-28 12:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1b7d8151-7119-57f9-be13-cd5ecb373c85
2026-03-28 12:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_11df6cc8714bde5dbceec8d82e586d45.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: FL38609
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: PR73005
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR73005%27 HTTP/1.1" 200 None
2026-03-28 12:06:15 [auto1.it] INFO: Scrape type for PR73005: 1
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: AL33204
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL33204%27 HTTP/1.1" 200 None
2026-03-28 12:06:15 [auto1.it] INFO: Scrape type for AL33204: 1
2026-03-28 12:06:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf63650>
2026-03-28 12:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b7d8151-7119-57f9-be13-cd5ecb373c85/1b7d8151-7119-57f9-be13-cd5ecb373c85_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fc8%252F1ac8376a89c10f343dcbcf68449f935a%252Fpa%252FUN20093_62006c306f6c60bbfabad49d002d4286.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_62006c306f6c60bbfabad49d002d4286.jpg saved to cache
2026-03-28 12:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1b7d8151-7119-57f9-be13-cd5ecb373c85
2026-03-28 12:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bceec090>
2026-03-28 12:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1540861-55d8-5622-83cc-65661a4f82a9/f1540861-55d8-5622-83cc-65661a4f82a9_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ffa%252Fb0fa5fe76c0edb84d6f2dd581689e2ef%252Fpa%252FFR55532_e3fad41716fb4922e3b7479ab0743010.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_e3fad41716fb4922e3b7479ab0743010.jpg saved to cache
2026-03-28 12:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f1540861-55d8-5622-83cc-65661a4f82a9
2026-03-28 12:06:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5be950>
2026-03-28 12:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1540861-55d8-5622-83cc-65661a4f82a9/f1540861-55d8-5622-83cc-65661a4f82a9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ffa%252Fb0fa5fe76c0edb84d6f2dd581689e2ef%252Fpa%252FFR55532_e41cc6d207d7f4045ca21fc0c5075312.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_e41cc6d207d7f4045ca21fc0c5075312.jpg saved to cache
2026-03-28 12:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f1540861-55d8-5622-83cc-65661a4f82a9
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: VU45167
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU45167%27 HTTP/1.1" 200 None
2026-03-28 12:06:15 [auto1.it] INFO: Scrape type for VU45167: 1
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: YD14292
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD14292%27 HTTP/1.1" 200 None
2026-03-28 12:06:15 [auto1.it] INFO: Scrape type for YD14292: 1
2026-03-28 12:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LF71839/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: HC79760
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC79760%27 HTTP/1.1" 200 None
2026-03-28 12:06:15 [auto1.it] INFO: Scrape type for HC79760: 1
2026-03-28 12:06:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bceed010>
2026-03-28 12:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d847a549-bef9-5b48-b0af-ad4a5c54f2d2/d847a549-bef9-5b48-b0af-ad4a5c54f2d2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F49%252Ff649cae8d0e344c8b0fdfe07053833a3%252Fpa%252FRC42052_11df6cc8714bde5dbceec8d82e586d45.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_11df6cc8714bde5dbceec8d82e586d45.jpg saved to cache
2026-03-28 12:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d847a549-bef9-5b48-b0af-ad4a5c54f2d2
2026-03-28 12:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KV81214/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VU78996/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: YJ65230
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: AY38539
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY38539%27 HTTP/1.1" 200 None
2026-03-28 12:06:15 [auto1.it] INFO: Scrape type for AY38539: 1
2026-03-28 12:06:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: FN08703
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN08703%27 HTTP/1.1" 200 None
2026-03-28 12:06:15 [auto1.it] INFO: Scrape type for FN08703: 1
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: DK59825
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: SN64311
2026-03-28 12:06:15 [auto1.it] INFO: Found listing with ID: WA74903
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA74903%27 HTTP/1.1" 200 None
2026-03-28 12:06:15 [auto1.it] INFO: Scrape type for WA74903: 2
2026-03-28 12:06:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8eea0ba7-0e9c-5f13-b01c-723e3e34d310 with identifier: WA74903
2026-03-28 12:06:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8eea0ba7-0e9c-5f13-b01c-723e3e34d310 with scrape type 2
2026-03-28 12:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8eea0ba7-0e9c-5f13-b01c-723e3e34d310 with scrape type 2
2026-03-28 12:06:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8eea0ba7-0e9c-5f13-b01c-723e3e34d310, identifier: WA74903
2026-03-28 12:06:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8eea0ba7-0e9c-5f13-b01c-723e3e34d310 with identifier: WA74903
2026-03-28 12:06:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8eea0ba7-0e9c-5f13-b01c-723e3e34d310 with identifier: WA74903
2026-03-28 12:06:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8eea0ba7-0e9c-5f13-b01c-723e3e34d310 with identifier: WA74903 to the API
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:58:46Z',
 'fuel_type': 'diesel',
 'id': '8eea0ba7-0e9c-5f13-b01c-723e3e34d310',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA74903',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 153552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-27',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.6 TDI Style BlueMotion',
 'transmission': 'manual',
 'trim': 'Style BlueMotion',
 'year': 2017}
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA74903%27 HTTP/1.1" 200 None
2026-03-28 12:06:16 [auto1.it] INFO: Saving data for WA74903: {'auction_closing_time': 1774886326.0, 'created_time': 1774440448.950955, 'last_price_update_time': 1774699576.500674}
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WA74903') HTTP/1.1" 204 0
2026-03-28 12:06:16 [auto1.it] INFO: Found listing with ID: JD08634
2026-03-28 12:06:16 [auto1.it] INFO: Found listing with ID: NV36405
2026-03-28 12:06:16 [auto1.it] INFO: Found listing with ID: EY62872
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY62872%27 HTTP/1.1" 200 None
2026-03-28 12:06:16 [auto1.it] INFO: Scrape type for EY62872: 1
2026-03-28 12:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LC50167/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XC50936/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:16 [auto1.it] INFO: Found listing with ID: RX99129
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX99129%27 HTTP/1.1" 200 None
2026-03-28 12:06:16 [auto1.it] INFO: Scrape type for RX99129: 1
2026-03-28 12:06:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DV86201/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:16 [auto1.it] INFO: Found listing with ID: MT10040
2026-03-28 12:06:16 [auto1.it] INFO: Found listing with ID: DE88474
2026-03-28 12:06:16 [auto1.it] INFO: Found listing with ID: FC40925
2026-03-28 12:06:16 [auto1.it] INFO: Found listing with ID: LB90809
2026-03-28 12:06:16 [auto1.it] INFO: Found listing with ID: EU57494
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU57494%27 HTTP/1.1" 200 None
2026-03-28 12:06:16 [auto1.it] INFO: Scrape type for EU57494: 1
2026-03-28 12:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_21429542c8c654d41bf5ffd49e33b880.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:16 [auto1.it] INFO: Found listing with ID: EG76959
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG76959%27 HTTP/1.1" 200 None
2026-03-28 12:06:16 [auto1.it] INFO: Scrape type for EG76959: 1
2026-03-28 12:06:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc583690>
2026-03-28 12:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d847a549-bef9-5b48-b0af-ad4a5c54f2d2/d847a549-bef9-5b48-b0af-ad4a5c54f2d2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F49%252Ff649cae8d0e344c8b0fdfe07053833a3%252Fpa%252FRC42052_21429542c8c654d41bf5ffd49e33b880.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_21429542c8c654d41bf5ffd49e33b880.jpg saved to cache
2026-03-28 12:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d847a549-bef9-5b48-b0af-ad4a5c54f2d2
2026-03-28 12:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DE18860/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SM49398/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VJ26511/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NH24051/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SZ93699/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VU45167/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UM38141/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AL33204/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HC79760/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PR73005/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YD14292/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EY62872/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LF71839> (referer: https://www.auto1.com/v1/car-details-view/LF71839/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EU57494/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f7db5a3-4d0d-5f29-a092-d00e71c3962e with identifier: LF71839
2026-03-28 12:06:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f7db5a3-4d0d-5f29-a092-d00e71c3962e with scrape type 1
2026-03-28 12:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1f7db5a3-4d0d-5f29-a092-d00e71c3962e
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F9d%252F3b9d98fef86238b278f78ff9754d5ffa%252Fpa%252FLF71839_b63a53d189fd667fcb5d961f05231a64.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_b63a53d189fd667fcb5d961f05231a64.jpg not downloaded yet
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F9d%252F3b9d98fef86238b278f78ff9754d5ffa%252Fpa%252FLF71839_8570d3539bf063139e237f008154e580.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_8570d3539bf063139e237f008154e580.jpg not downloaded yet
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F9d%252F3b9d98fef86238b278f78ff9754d5ffa%252Fpa%252FLF71839_b3f61d7de082dbc7f99c5a20406e1ecd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_b3f61d7de082dbc7f99c5a20406e1ecd.jpg not downloaded yet
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F9d%252F3b9d98fef86238b278f78ff9754d5ffa%252Fpa%252FLF71839_9f51835283c123b09e10ca09f726c946.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_9f51835283c123b09e10ca09f726c946.jpg not downloaded yet
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F9d%252F3b9d98fef86238b278f78ff9754d5ffa%252Fpa%252FLF71839_da9cfb5df3648d210a030672e5feadf9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_da9cfb5df3648d210a030672e5feadf9.jpg not downloaded yet
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F9d%252F3b9d98fef86238b278f78ff9754d5ffa%252Fpa%252FLF71839_4b6d3ee2b797f5e063d3b14004efb2c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_4b6d3ee2b797f5e063d3b14004efb2c6.jpg not downloaded yet
2026-03-28 12:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RX99129/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F9d%252F3b9d98fef86238b278f78ff9754d5ffa%252Fpa%252FLF71839_4c937060fa8bd66ba856cadaf5815937.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_4c937060fa8bd66ba856cadaf5815937.jpg not downloaded yet
2026-03-28 12:06:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F9d%252F3b9d98fef86238b278f78ff9754d5ffa%252Fpa%252FLF71839_2bac01db1361e3f1be885b7527421152.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_2bac01db1361e3f1be885b7527421152.jpg not downloaded yet
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F9d%252F3b9d98fef86238b278f78ff9754d5ffa%252Fpa%252FLF71839_0f982f8b746d675af827fc0c279a21be.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_0f982f8b746d675af827fc0c279a21be.jpg not downloaded yet
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F9d%252F3b9d98fef86238b278f78ff9754d5ffa%252Fpa%252FLF71839_92c27f2472451c12b11c313bf899577f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_92c27f2472451c12b11c313bf899577f.jpg not downloaded yet
2026-03-28 12:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DV86201> (referer: https://www.auto1.com/v1/car-details-view/DV86201/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b437e8b-a37a-53ec-8205-69705c9ab3cb with identifier: DV86201
2026-03-28 12:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b437e8b-a37a-53ec-8205-69705c9ab3cb with scrape type 1
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5b437e8b-a37a-53ec-8205-69705c9ab3cb
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F39%252F8a39ab45a3258320dc9f2f2ca4330fea%252Fpa%252FDV86201_319b26c10013ccdfad341e94f0abc7c7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_319b26c10013ccdfad341e94f0abc7c7.jpg not downloaded yet
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F39%252F8a39ab45a3258320dc9f2f2ca4330fea%252Fpa%252FDV86201_ba1c811c4371789c43bde90f65473d23.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_ba1c811c4371789c43bde90f65473d23.jpg not downloaded yet
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F39%252F8a39ab45a3258320dc9f2f2ca4330fea%252Fpa%252FDV86201_c52abcec616793c3860af696cdf4faf5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_c52abcec616793c3860af696cdf4faf5.jpg not downloaded yet
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F39%252F8a39ab45a3258320dc9f2f2ca4330fea%252Fpa%252FDV86201_35f44843d72d7338ee4cedfdc6243d29.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_35f44843d72d7338ee4cedfdc6243d29.jpg not downloaded yet
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F39%252F8a39ab45a3258320dc9f2f2ca4330fea%252Fpa%252FDV86201_fa88a2c1a64c4e62950bbd0521641a0d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_fa88a2c1a64c4e62950bbd0521641a0d.jpg not downloaded yet
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F39%252F8a39ab45a3258320dc9f2f2ca4330fea%252Fpa%252FDV86201_9419d016992b867e703b39d5590a12b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_9419d016992b867e703b39d5590a12b5.jpg not downloaded yet
2026-03-28 12:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_92c27f2472451c12b11c313bf899577f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F39%252F8a39ab45a3258320dc9f2f2ca4330fea%252Fpa%252FDV86201_2c95d70d5b829817e4bd067a13551bea.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_2c95d70d5b829817e4bd067a13551bea.jpg not downloaded yet
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F39%252F8a39ab45a3258320dc9f2f2ca4330fea%252Fpa%252FDV86201_63f196522e4961a62d3225168589de26.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_63f196522e4961a62d3225168589de26.jpg not downloaded yet
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F39%252F8a39ab45a3258320dc9f2f2ca4330fea%252Fpa%252FDV86201_1baddf7e956269f5f572ec6d81b87470.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_1baddf7e956269f5f572ec6d81b87470.jpg not downloaded yet
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F39%252F8a39ab45a3258320dc9f2f2ca4330fea%252Fpa%252FDV86201_44b582aa276aa104e0bea7ccf57c75e0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_44b582aa276aa104e0bea7ccf57c75e0.jpg not downloaded yet
2026-03-28 12:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DE18860> (referer: https://www.auto1.com/v1/car-details-view/DE18860/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc582910>
2026-03-28 12:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7db5a3-4d0d-5f29-a092-d00e71c3962e/1f7db5a3-4d0d-5f29-a092-d00e71c3962e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F9d%252F3b9d98fef86238b278f78ff9754d5ffa%252Fpa%252FLF71839_92c27f2472451c12b11c313bf899577f.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_92c27f2472451c12b11c313bf899577f.jpg saved to cache
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1f7db5a3-4d0d-5f29-a092-d00e71c3962e
2026-03-28 12:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XC50936> (referer: https://www.auto1.com/v1/car-details-view/XC50936/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_44b582aa276aa104e0bea7ccf57c75e0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7ebd939-dde9-544e-83bf-0dca02f95948 with identifier: DE18860
2026-03-28 12:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7ebd939-dde9-544e-83bf-0dca02f95948 with scrape type 1
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d7ebd939-dde9-544e-83bf-0dca02f95948
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89738f1197d3c304202c5c76447931%252Fpa%252FDE18860_71cd389dbb98110504cfa037529577ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_71cd389dbb98110504cfa037529577ac.jpg not downloaded yet
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89738f1197d3c304202c5c76447931%252Fpa%252FDE18860_f21902c1ab655978fd9e08e0846a9dab.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_f21902c1ab655978fd9e08e0846a9dab.jpg not downloaded yet
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89738f1197d3c304202c5c76447931%252Fpa%252FDE18860_384625eff70509df997b29189654c41b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_384625eff70509df997b29189654c41b.jpg not downloaded yet
2026-03-28 12:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LC50167> (referer: https://www.auto1.com/v1/car-details-view/LC50167/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_9419d016992b867e703b39d5590a12b5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89738f1197d3c304202c5c76447931%252Fpa%252FDE18860_ec85b2f067007d50d83203e1b147bcf1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_ec85b2f067007d50d83203e1b147bcf1.jpg not downloaded yet
2026-03-28 12:06:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5514494a-dc0b-5478-91e5-55e8c15cd12d with identifier: XC50936
2026-03-28 12:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5514494a-dc0b-5478-91e5-55e8c15cd12d with scrape type 1
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5514494a-dc0b-5478-91e5-55e8c15cd12d
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fc9%252F1dc90068bf1fd412dfe0f2d30f8678da%252Fpa%252FXC50936_59d580ca676ff6945c89650bb205222b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/c9/1dc90068bf1fd412dfe0f2d30f8678da/pa/XC50936_59d580ca676ff6945c89650bb205222b.jpg already downloaded
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fc9%252F1dc90068bf1fd412dfe0f2d30f8678da%252Fpa%252FXC50936_c93682ec713053e9b0b5c70129c43c8e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/c9/1dc90068bf1fd412dfe0f2d30f8678da/pa/XC50936_c93682ec713053e9b0b5c70129c43c8e.jpg already downloaded
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fc9%252F1dc90068bf1fd412dfe0f2d30f8678da%252Fpa%252FXC50936_507e106972407fc544e55846655ef692.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/c9/1dc90068bf1fd412dfe0f2d30f8678da/pa/XC50936_507e106972407fc544e55846655ef692.jpg already downloaded
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fc9%252F1dc90068bf1fd412dfe0f2d30f8678da%252Fpa%252FXC50936_dc9fc99ac261f6343eda38f181e0ee11.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/c9/1dc90068bf1fd412dfe0f2d30f8678da/pa/XC50936_dc9fc99ac261f6343eda38f181e0ee11.jpg already downloaded
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fc9%252F1dc90068bf1fd412dfe0f2d30f8678da%252Fpa%252FXC50936_4c0c581dedeaddaecbe0ba2427a2dc95.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/c9/1dc90068bf1fd412dfe0f2d30f8678da/pa/XC50936_4c0c581dedeaddaecbe0ba2427a2dc95.jpg already downloaded
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fc9%252F1dc90068bf1fd412dfe0f2d30f8678da%252Fpa%252FXC50936_92f66815af5720ee74fef4c4d570da88.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/c9/1dc90068bf1fd412dfe0f2d30f8678da/pa/XC50936_92f66815af5720ee74fef4c4d570da88.jpg already downloaded
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fc9%252F1dc90068bf1fd412dfe0f2d30f8678da%252Fpa%252FXC50936_14dad143e94be05ae395321dc1f9ac67.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/c9/1dc90068bf1fd412dfe0f2d30f8678da/pa/XC50936_14dad143e94be05ae395321dc1f9ac67.jpg already downloaded
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fc9%252F1dc90068bf1fd412dfe0f2d30f8678da%252Fpa%252FXC50936_c1d84926c8898aa11ec18cf03cba5922.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/c9/1dc90068bf1fd412dfe0f2d30f8678da/pa/XC50936_c1d84926c8898aa11ec18cf03cba5922.jpg already downloaded
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fc9%252F1dc90068bf1fd412dfe0f2d30f8678da%252Fpa%252FXC50936_64901c81ac44201e3d5a2e6dd747225a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/c9/1dc90068bf1fd412dfe0f2d30f8678da/pa/XC50936_64901c81ac44201e3d5a2e6dd747225a.jpg already downloaded
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fc9%252F1dc90068bf1fd412dfe0f2d30f8678da%252Fpa%252FXC50936_cfe23d5195ea3031e598c56eddb56c58.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/c9/1dc90068bf1fd412dfe0f2d30f8678da/pa/XC50936_cfe23d5195ea3031e598c56eddb56c58.jpg already downloaded
2026-03-28 12:06:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5514494a-dc0b-5478-91e5-55e8c15cd12d, identifier: XC50936
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89738f1197d3c304202c5c76447931%252Fpa%252FDE18860_952a240ac749349f7d713911408d959c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_952a240ac749349f7d713911408d959c.jpg not downloaded yet
2026-03-28 12:06:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5514494a-dc0b-5478-91e5-55e8c15cd12d with identifier: XC50936
2026-03-28 12:06:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5514494a-dc0b-5478-91e5-55e8c15cd12d with identifier: XC50936
2026-03-28 12:06:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5514494a-dc0b-5478-91e5-55e8c15cd12d with identifier: XC50936 to the API
2026-03-28 12:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XC50936>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:46:34Z',
 'fuel_type': 'petrol',
 'id': '5514494a-dc0b-5478-91e5-55e8c15cd12d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC50936',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 59953,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img1d/c9/1dc90068bf1fd412dfe0f2d30f8678da/pa/XC50936_59d580ca676ff6945c89650bb205222b.jpg',
                'https://img-pa.auto1.com/img1d/c9/1dc90068bf1fd412dfe0f2d30f8678da/pa/XC50936_c93682ec713053e9b0b5c70129c43c8e.jpg',
                'https://img-pa.auto1.com/img1d/c9/1dc90068bf1fd412dfe0f2d30f8678da/pa/XC50936_507e106972407fc544e55846655ef692.jpg',
                'https://img-pa.auto1.com/img1d/c9/1dc90068bf1fd412dfe0f2d30f8678da/pa/XC50936_dc9fc99ac261f6343eda38f181e0ee11.jpg',
                'https://img-pa.auto1.com/img1d/c9/1dc90068bf1fd412dfe0f2d30f8678da/pa/XC50936_4c0c581dedeaddaecbe0ba2427a2dc95.jpg',
                'https://img-pa.auto1.com/img1d/c9/1dc90068bf1fd412dfe0f2d30f8678da/pa/XC50936_92f66815af5720ee74fef4c4d570da88.jpg',
                'https://img-pa.auto1.com/img1d/c9/1dc90068bf1fd412dfe0f2d30f8678da/pa/XC50936_14dad143e94be05ae395321dc1f9ac67.jpg',
                'https://img-pa.auto1.com/img1d/c9/1dc90068bf1fd412dfe0f2d30f8678da/pa/XC50936_c1d84926c8898aa11ec18cf03cba5922.jpg',
                'https://img-pa.auto1.com/img1d/c9/1dc90068bf1fd412dfe0f2d30f8678da/pa/XC50936_64901c81ac44201e3d5a2e6dd747225a.jpg',
                'https://img-pa.auto1.com/img1d/c9/1dc90068bf1fd412dfe0f2d30f8678da/pa/XC50936_cfe23d5195ea3031e598c56eddb56c58.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5514494a-dc0b-5478-91e5-55e8c15cd12d/5514494a-dc0b-5478-91e5-55e8c15cd12d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/c9/1dc90068bf1fd412dfe0f2d30f8678da/pa/XC50936_59d580ca676ff6945c89650bb205222b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5514494a-dc0b-5478-91e5-55e8c15cd12d/5514494a-dc0b-5478-91e5-55e8c15cd12d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/c9/1dc90068bf1fd412dfe0f2d30f8678da/pa/XC50936_c93682ec713053e9b0b5c70129c43c8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5514494a-dc0b-5478-91e5-55e8c15cd12d/5514494a-dc0b-5478-91e5-55e8c15cd12d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/c9/1dc90068bf1fd412dfe0f2d30f8678da/pa/XC50936_507e106972407fc544e55846655ef692.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5514494a-dc0b-5478-91e5-55e8c15cd12d/5514494a-dc0b-5478-91e5-55e8c15cd12d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/c9/1dc90068bf1fd412dfe0f2d30f8678da/pa/XC50936_dc9fc99ac261f6343eda38f181e0ee11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5514494a-dc0b-5478-91e5-55e8c15cd12d/5514494a-dc0b-5478-91e5-55e8c15cd12d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/c9/1dc90068bf1fd412dfe0f2d30f8678da/pa/XC50936_4c0c581dedeaddaecbe0ba2427a2dc95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5514494a-dc0b-5478-91e5-55e8c15cd12d/5514494a-dc0b-5478-91e5-55e8c15cd12d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/c9/1dc90068bf1fd412dfe0f2d30f8678da/pa/XC50936_92f66815af5720ee74fef4c4d570da88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5514494a-dc0b-5478-91e5-55e8c15cd12d/5514494a-dc0b-5478-91e5-55e8c15cd12d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/c9/1dc90068bf1fd412dfe0f2d30f8678da/pa/XC50936_14dad143e94be05ae395321dc1f9ac67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5514494a-dc0b-5478-91e5-55e8c15cd12d/5514494a-dc0b-5478-91e5-55e8c15cd12d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72710,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/c9/1dc90068bf1fd412dfe0f2d30f8678da/pa/XC50936_c1d84926c8898aa11ec18cf03cba5922.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5514494a-dc0b-5478-91e5-55e8c15cd12d/5514494a-dc0b-5478-91e5-55e8c15cd12d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/c9/1dc90068bf1fd412dfe0f2d30f8678da/pa/XC50936_64901c81ac44201e3d5a2e6dd747225a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5514494a-dc0b-5478-91e5-55e8c15cd12d/5514494a-dc0b-5478-91e5-55e8c15cd12d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/c9/1dc90068bf1fd412dfe0f2d30f8678da/pa/XC50936_cfe23d5195ea3031e598c56eddb56c58.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q2 30 TFSI Admired',
 'transmission': 'manual',
 'trim': 'Admired',
 'year': 2020}
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC50936%27 HTTP/1.1" 200 None
2026-03-28 12:06:20 [auto1.it] INFO: Saving data for XC50936: {'created_time': 1774699580.26613, 'last_price_update_time': 1774699580.266139, 'auction_closing_time': 1774885594.0}
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XC50936') HTTP/1.1" 204 0
2026-03-28 12:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_63f196522e4961a62d3225168589de26.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd0f2dd0>
2026-03-28 12:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b437e8b-a37a-53ec-8205-69705c9ab3cb/5b437e8b-a37a-53ec-8205-69705c9ab3cb_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F39%252F8a39ab45a3258320dc9f2f2ca4330fea%252Fpa%252FDV86201_44b582aa276aa104e0bea7ccf57c75e0.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_44b582aa276aa104e0bea7ccf57c75e0.jpg saved to cache
2026-03-28 12:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5b437e8b-a37a-53ec-8205-69705c9ab3cb
2026-03-28 12:06:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99331b19-07da-57c2-8f19-2bf79e0ae01c with identifier: LC50167
2026-03-28 12:06:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99331b19-07da-57c2-8f19-2bf79e0ae01c with scrape type 1
2026-03-28 12:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 99331b19-07da-57c2-8f19-2bf79e0ae01c
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fda%252F51dac849c5c7fed6fd1d19543af9859a%252Fpa%252FLC50167_22ff957baefd8b5cf0f4b6d965584da5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_22ff957baefd8b5cf0f4b6d965584da5.jpg not downloaded yet
2026-03-28 12:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc65f950>
2026-03-28 12:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b437e8b-a37a-53ec-8205-69705c9ab3cb/5b437e8b-a37a-53ec-8205-69705c9ab3cb_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F39%252F8a39ab45a3258320dc9f2f2ca4330fea%252Fpa%252FDV86201_9419d016992b867e703b39d5590a12b5.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_9419d016992b867e703b39d5590a12b5.jpg saved to cache
2026-03-28 12:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5b437e8b-a37a-53ec-8205-69705c9ab3cb
2026-03-28 12:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VJ26511> (referer: https://www.auto1.com/v1/car-details-view/VJ26511/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NH24051> (referer: https://www.auto1.com/v1/car-details-view/NH24051/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SZ93699> (referer: https://www.auto1.com/v1/car-details-view/SZ93699/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fda%252F51dac849c5c7fed6fd1d19543af9859a%252Fpa%252FLC50167_2d70c3213205872e90ec23134916d59d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_2d70c3213205872e90ec23134916d59d.jpg not downloaded yet
2026-03-28 12:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_384625eff70509df997b29189654c41b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_f21902c1ab655978fd9e08e0846a9dab.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VU45167> (referer: https://www.auto1.com/v1/car-details-view/VU45167/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc65e350>
2026-03-28 12:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b437e8b-a37a-53ec-8205-69705c9ab3cb/5b437e8b-a37a-53ec-8205-69705c9ab3cb_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F39%252F8a39ab45a3258320dc9f2f2ca4330fea%252Fpa%252FDV86201_63f196522e4961a62d3225168589de26.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_63f196522e4961a62d3225168589de26.jpg saved to cache
2026-03-28 12:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5b437e8b-a37a-53ec-8205-69705c9ab3cb
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fda%252F51dac849c5c7fed6fd1d19543af9859a%252Fpa%252FLC50167_c68252469b89c52501e1831b64dfccf0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_c68252469b89c52501e1831b64dfccf0.jpg not downloaded yet
2026-03-28 12:06:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_952a240ac749349f7d713911408d959c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fda%252F51dac849c5c7fed6fd1d19543af9859a%252Fpa%252FLC50167_08298882697f2fa719a1314a3d1ab4c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_08298882697f2fa719a1314a3d1ab4c9.jpg not downloaded yet
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fda%252F51dac849c5c7fed6fd1d19543af9859a%252Fpa%252FLC50167_e95bfc8b4f261cb48e2115cd3497e7f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_e95bfc8b4f261cb48e2115cd3497e7f3.jpg not downloaded yet
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fda%252F51dac849c5c7fed6fd1d19543af9859a%252Fpa%252FLC50167_b90faeefcf617870a5f03b2d68d0a701.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_b90faeefcf617870a5f03b2d68d0a701.jpg not downloaded yet
2026-03-28 12:06:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4e4cb87-df47-57e4-b8ad-6419a1fd3c07 with identifier: VJ26511
2026-03-28 12:06:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4e4cb87-df47-57e4-b8ad-6419a1fd3c07 with scrape type 1
2026-03-28 12:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b4e4cb87-df47-57e4-b8ad-6419a1fd3c07
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F62%252Fdb62b21d8b75e15ca8777883db174739%252Fpa%252FVJ26511_7d97a0062e77ad538c868167bf88f454.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_7d97a0062e77ad538c868167bf88f454.jpg not downloaded yet
2026-03-28 12:06:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1243bd0-46f1-5baf-b660-022079bee133 with identifier: NH24051
2026-03-28 12:06:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1243bd0-46f1-5baf-b660-022079bee133 with scrape type 1
2026-03-28 12:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item b1243bd0-46f1-5baf-b660-022079bee133
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Ffb%252Fdffbdbaf1b046cd237b3b3131303d694%252Fpa%252FNH24051_8abe03a768d48e03d84edcc1874c8701.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/fb/dffbdbaf1b046cd237b3b3131303d694/pa/NH24051_8abe03a768d48e03d84edcc1874c8701.jpg already downloaded
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Ffb%252Fdffbdbaf1b046cd237b3b3131303d694%252Fpa%252FNH24051_cbaa966cefd9656ca1a25cafe307ee67.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/fb/dffbdbaf1b046cd237b3b3131303d694/pa/NH24051_cbaa966cefd9656ca1a25cafe307ee67.jpg already downloaded
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Ffb%252Fdffbdbaf1b046cd237b3b3131303d694%252Fpa%252FNH24051_58bda3f6836855cd0d4681abdcdd6744.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/fb/dffbdbaf1b046cd237b3b3131303d694/pa/NH24051_58bda3f6836855cd0d4681abdcdd6744.jpg already downloaded
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Ffb%252Fdffbdbaf1b046cd237b3b3131303d694%252Fpa%252FNH24051_79b90e65ebd5423b6f8fa0ea58685559.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/fb/dffbdbaf1b046cd237b3b3131303d694/pa/NH24051_79b90e65ebd5423b6f8fa0ea58685559.jpg already downloaded
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Ffb%252Fdffbdbaf1b046cd237b3b3131303d694%252Fpa%252FNH24051_d4c45d568b443c5efd0d3088df93d5b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/fb/dffbdbaf1b046cd237b3b3131303d694/pa/NH24051_d4c45d568b443c5efd0d3088df93d5b7.jpg already downloaded
2026-03-28 12:06:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b1243bd0-46f1-5baf-b660-022079bee133, identifier: NH24051
2026-03-28 12:06:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73d7fc43-fb9d-5932-a17a-a2dbfd8793c0 with identifier: SZ93699
2026-03-28 12:06:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73d7fc43-fb9d-5932-a17a-a2dbfd8793c0 with scrape type 1
2026-03-28 12:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 73d7fc43-fb9d-5932-a17a-a2dbfd8793c0
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fab%252F41abba4c065e15e533dd8e7a58ac874a%252Fpa%252FSZ93699_fa9a5beb01c7557501e675b270cb06c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/ab/41abba4c065e15e533dd8e7a58ac874a/pa/SZ93699_fa9a5beb01c7557501e675b270cb06c5.jpg not downloaded yet
2026-03-28 12:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_fa88a2c1a64c4e62950bbd0521641a0d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b1243bd0-46f1-5baf-b660-022079bee133 with identifier: NH24051
2026-03-28 12:06:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b1243bd0-46f1-5baf-b660-022079bee133 with identifier: NH24051
2026-03-28 12:06:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b1243bd0-46f1-5baf-b660-022079bee133 with identifier: NH24051 to the API
2026-03-28 12:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NH24051>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:02:37Z',
 'fuel_type': 'diesel',
 'id': 'b1243bd0-46f1-5baf-b660-022079bee133',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH24051',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 266049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgdf/fb/dffbdbaf1b046cd237b3b3131303d694/pa/NH24051_8abe03a768d48e03d84edcc1874c8701.jpg',
                'https://img-pa.auto1.com/imgdf/fb/dffbdbaf1b046cd237b3b3131303d694/pa/NH24051_cbaa966cefd9656ca1a25cafe307ee67.jpg',
                'https://img-pa.auto1.com/imgdf/fb/dffbdbaf1b046cd237b3b3131303d694/pa/NH24051_58bda3f6836855cd0d4681abdcdd6744.jpg',
                'https://img-pa.auto1.com/imgdf/fb/dffbdbaf1b046cd237b3b3131303d694/pa/NH24051_79b90e65ebd5423b6f8fa0ea58685559.jpg',
                'https://img-pa.auto1.com/imgdf/fb/dffbdbaf1b046cd237b3b3131303d694/pa/NH24051_d4c45d568b443c5efd0d3088df93d5b7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b88f085-a87e-5bc2-9848-3bf06eeb97a8/9b88f085-a87e-5bc2-9848-3bf06eeb97a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71396,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/fb/dffbdbaf1b046cd237b3b3131303d694/pa/NH24051_8abe03a768d48e03d84edcc1874c8701.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b88f085-a87e-5bc2-9848-3bf06eeb97a8/9b88f085-a87e-5bc2-9848-3bf06eeb97a8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/fb/dffbdbaf1b046cd237b3b3131303d694/pa/NH24051_cbaa966cefd9656ca1a25cafe307ee67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b88f085-a87e-5bc2-9848-3bf06eeb97a8/9b88f085-a87e-5bc2-9848-3bf06eeb97a8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/fb/dffbdbaf1b046cd237b3b3131303d694/pa/NH24051_58bda3f6836855cd0d4681abdcdd6744.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1243bd0-46f1-5baf-b660-022079bee133/b1243bd0-46f1-5baf-b660-022079bee133_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60932,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/fb/dffbdbaf1b046cd237b3b3131303d694/pa/NH24051_79b90e65ebd5423b6f8fa0ea58685559.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b88f085-a87e-5bc2-9848-3bf06eeb97a8/9b88f085-a87e-5bc2-9848-3bf06eeb97a8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/fb/dffbdbaf1b046cd237b3b3131303d694/pa/NH24051_d4c45d568b443c5efd0d3088df93d5b7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-09-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Scenic 1.5 dCi Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2014}
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH24051%27 HTTP/1.1" 200 None
2026-03-28 12:06:21 [auto1.it] INFO: Saving data for NH24051: {'created_time': 1774699581.155183, 'last_price_update_time': 1774699581.155194, 'auction_closing_time': 1774882957.0}
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NH24051') HTTP/1.1" 204 0
2026-03-28 12:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_71cd389dbb98110504cfa037529577ac.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_22ff957baefd8b5cf0f4b6d965584da5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_ec85b2f067007d50d83203e1b147bcf1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_2c95d70d5b829817e4bd067a13551bea.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fda%252F51dac849c5c7fed6fd1d19543af9859a%252Fpa%252FLC50167_f2aa64783d0438a5345a731848ec99fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_f2aa64783d0438a5345a731848ec99fe.jpg not downloaded yet
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F62%252Fdb62b21d8b75e15ca8777883db174739%252Fpa%252FVJ26511_7f1c5292c2967b2765b11d4b53feeb06.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_7f1c5292c2967b2765b11d4b53feeb06.jpg not downloaded yet
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fab%252F41abba4c065e15e533dd8e7a58ac874a%252Fpa%252FSZ93699_9b0bb27e165c2390330216f1ad248c86.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/ab/41abba4c065e15e533dd8e7a58ac874a/pa/SZ93699_9b0bb27e165c2390330216f1ad248c86.jpg not downloaded yet
2026-03-28 12:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc272150>
2026-03-28 12:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7ebd939-dde9-544e-83bf-0dca02f95948/d7ebd939-dde9-544e-83bf-0dca02f95948_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89738f1197d3c304202c5c76447931%252Fpa%252FDE18860_384625eff70509df997b29189654c41b.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_384625eff70509df997b29189654c41b.jpg saved to cache
2026-03-28 12:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d7ebd939-dde9-544e-83bf-0dca02f95948
2026-03-28 12:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3a81d0>
2026-03-28 12:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7ebd939-dde9-544e-83bf-0dca02f95948/d7ebd939-dde9-544e-83bf-0dca02f95948_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89738f1197d3c304202c5c76447931%252Fpa%252FDE18860_f21902c1ab655978fd9e08e0846a9dab.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_f21902c1ab655978fd9e08e0846a9dab.jpg saved to cache
2026-03-28 12:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d7ebd939-dde9-544e-83bf-0dca02f95948
2026-03-28 12:06:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30f35d65-c75a-544a-bcc6-29d77a5b267f with identifier: VU45167
2026-03-28 12:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30f35d65-c75a-544a-bcc6-29d77a5b267f with scrape type 1
2026-03-28 12:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 30f35d65-c75a-544a-bcc6-29d77a5b267f
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F97%252Fa597a3d71076ca34f9a1fd745e8975d4%252Fpa%252FVU45167_6f121af97fde8a18970ab86342438c7e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_6f121af97fde8a18970ab86342438c7e.jpg not downloaded yet
2026-03-28 12:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc559cd0>
2026-03-28 12:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7ebd939-dde9-544e-83bf-0dca02f95948/d7ebd939-dde9-544e-83bf-0dca02f95948_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89738f1197d3c304202c5c76447931%252Fpa%252FDE18860_952a240ac749349f7d713911408d959c.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_952a240ac749349f7d713911408d959c.jpg saved to cache
2026-03-28 12:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d7ebd939-dde9-544e-83bf-0dca02f95948
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fda%252F51dac849c5c7fed6fd1d19543af9859a%252Fpa%252FLC50167_90ba91690457ae4057cb86220a7e03bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_90ba91690457ae4057cb86220a7e03bb.jpg not downloaded yet
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F62%252Fdb62b21d8b75e15ca8777883db174739%252Fpa%252FVJ26511_c9fc8f65caab6a749c188c88ee199f5f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_c9fc8f65caab6a749c188c88ee199f5f.jpg not downloaded yet
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fab%252F41abba4c065e15e533dd8e7a58ac874a%252Fpa%252FSZ93699_8951091ffac4ed7131284583b9c04ac7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/ab/41abba4c065e15e533dd8e7a58ac874a/pa/SZ93699_8951091ffac4ed7131284583b9c04ac7.jpg not downloaded yet
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F97%252Fa597a3d71076ca34f9a1fd745e8975d4%252Fpa%252FVU45167_fa16b73f10e6c4214f610e35fdbdf039.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_fa16b73f10e6c4214f610e35fdbdf039.jpg not downloaded yet
2026-03-28 12:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AL33204> (referer: https://www.auto1.com/v1/car-details-view/AL33204/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UM38141> (referer: https://www.auto1.com/v1/car-details-view/UM38141/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HC79760> (referer: https://www.auto1.com/v1/car-details-view/HC79760/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc59a450>
2026-03-28 12:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b437e8b-a37a-53ec-8205-69705c9ab3cb/5b437e8b-a37a-53ec-8205-69705c9ab3cb_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F39%252F8a39ab45a3258320dc9f2f2ca4330fea%252Fpa%252FDV86201_fa88a2c1a64c4e62950bbd0521641a0d.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_fa88a2c1a64c4e62950bbd0521641a0d.jpg saved to cache
2026-03-28 12:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5b437e8b-a37a-53ec-8205-69705c9ab3cb
2026-03-28 12:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc592c50>
2026-03-28 12:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7ebd939-dde9-544e-83bf-0dca02f95948/d7ebd939-dde9-544e-83bf-0dca02f95948_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89738f1197d3c304202c5c76447931%252Fpa%252FDE18860_71cd389dbb98110504cfa037529577ac.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_71cd389dbb98110504cfa037529577ac.jpg saved to cache
2026-03-28 12:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d7ebd939-dde9-544e-83bf-0dca02f95948
2026-03-28 12:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc383790>
2026-03-28 12:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99331b19-07da-57c2-8f19-2bf79e0ae01c/99331b19-07da-57c2-8f19-2bf79e0ae01c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fda%252F51dac849c5c7fed6fd1d19543af9859a%252Fpa%252FLC50167_22ff957baefd8b5cf0f4b6d965584da5.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_22ff957baefd8b5cf0f4b6d965584da5.jpg saved to cache
2026-03-28 12:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99331b19-07da-57c2-8f19-2bf79e0ae01c
2026-03-28 12:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3be1d0>
2026-03-28 12:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7ebd939-dde9-544e-83bf-0dca02f95948/d7ebd939-dde9-544e-83bf-0dca02f95948_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89738f1197d3c304202c5c76447931%252Fpa%252FDE18860_ec85b2f067007d50d83203e1b147bcf1.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_ec85b2f067007d50d83203e1b147bcf1.jpg saved to cache
2026-03-28 12:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d7ebd939-dde9-544e-83bf-0dca02f95948
2026-03-28 12:06:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d7ebd939-dde9-544e-83bf-0dca02f95948, skipping ID generation
2026-03-28 12:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7ebd939-dde9-544e-83bf-0dca02f95948 with scrape type 1
2026-03-28 12:06:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d7ebd939-dde9-544e-83bf-0dca02f95948 sending to next pipeline
2026-03-28 12:06:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d7ebd939-dde9-544e-83bf-0dca02f95948, identifier: DE18860
2026-03-28 12:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc610350>
2026-03-28 12:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b437e8b-a37a-53ec-8205-69705c9ab3cb/5b437e8b-a37a-53ec-8205-69705c9ab3cb_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F39%252F8a39ab45a3258320dc9f2f2ca4330fea%252Fpa%252FDV86201_2c95d70d5b829817e4bd067a13551bea.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_2c95d70d5b829817e4bd067a13551bea.jpg saved to cache
2026-03-28 12:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5b437e8b-a37a-53ec-8205-69705c9ab3cb
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fda%252F51dac849c5c7fed6fd1d19543af9859a%252Fpa%252FLC50167_8cb0107ab0c1959c3efa77165b672040.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_8cb0107ab0c1959c3efa77165b672040.jpg not downloaded yet
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F62%252Fdb62b21d8b75e15ca8777883db174739%252Fpa%252FVJ26511_92486d378eb955640e14c23877876dee.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_92486d378eb955640e14c23877876dee.jpg not downloaded yet
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fab%252F41abba4c065e15e533dd8e7a58ac874a%252Fpa%252FSZ93699_02484abe86d729c17e35acd2a77cb84d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/ab/41abba4c065e15e533dd8e7a58ac874a/pa/SZ93699_02484abe86d729c17e35acd2a77cb84d.jpg not downloaded yet
2026-03-28 12:06:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d7ebd939-dde9-544e-83bf-0dca02f95948 with identifier: DE18860
2026-03-28 12:06:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d7ebd939-dde9-544e-83bf-0dca02f95948 with identifier: DE18860
2026-03-28 12:06:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d7ebd939-dde9-544e-83bf-0dca02f95948 with identifier: DE18860 to the API
2026-03-28 12:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_ec85b2f067007d50d83203e1b147bcf1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': 'Rental',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:33:22Z',
 'fuel_type': 'petrol',
 'id': 'd7ebd939-dde9-544e-83bf-0dca02f95948',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE18860',
 'listing': 'auction',
 'location': 'IT, Verona',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 150019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7ebd939-dde9-544e-83bf-0dca02f95948/d7ebd939-dde9-544e-83bf-0dca02f95948_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_71cd389dbb98110504cfa037529577ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7ebd939-dde9-544e-83bf-0dca02f95948/d7ebd939-dde9-544e-83bf-0dca02f95948_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_f21902c1ab655978fd9e08e0846a9dab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7ebd939-dde9-544e-83bf-0dca02f95948/d7ebd939-dde9-544e-83bf-0dca02f95948_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_384625eff70509df997b29189654c41b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7ebd939-dde9-544e-83bf-0dca02f95948/d7ebd939-dde9-544e-83bf-0dca02f95948_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92003,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_ec85b2f067007d50d83203e1b147bcf1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7ebd939-dde9-544e-83bf-0dca02f95948/d7ebd939-dde9-544e-83bf-0dca02f95948_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_952a240ac749349f7d713911408d959c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-05-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2014}
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE18860%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [auto1.it] INFO: Saving data for DE18860: {'created_time': 1774699582.153401, 'last_price_update_time': 1774699582.153411, 'auction_closing_time': 1774884802.0}
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DE18860') HTTP/1.1" 204 0
2026-03-28 12:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/ab/41abba4c065e15e533dd8e7a58ac874a/pa/SZ93699_fa9a5beb01c7557501e675b270cb06c5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_7d97a0062e77ad538c868167bf88f454.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F97%252Fa597a3d71076ca34f9a1fd745e8975d4%252Fpa%252FVU45167_eb5149cb1f514b632df2e9b35e76103c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_eb5149cb1f514b632df2e9b35e76103c.jpg not downloaded yet
2026-03-28 12:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_08298882697f2fa719a1314a3d1ab4c9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fda%252F51dac849c5c7fed6fd1d19543af9859a%252Fpa%252FLC50167_a75d50a595c8a8eab40b0387d88d9b95.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_a75d50a595c8a8eab40b0387d88d9b95.jpg not downloaded yet
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F62%252Fdb62b21d8b75e15ca8777883db174739%252Fpa%252FVJ26511_dddd342de4b7f4453f32bdbba660e4d5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_dddd342de4b7f4453f32bdbba660e4d5.jpg not downloaded yet
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fab%252F41abba4c065e15e533dd8e7a58ac874a%252Fpa%252FSZ93699_7bde064678541e03b1f22254a1894c73.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/ab/41abba4c065e15e533dd8e7a58ac874a/pa/SZ93699_7bde064678541e03b1f22254a1894c73.jpg not downloaded yet
2026-03-28 12:06:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3225aaca-17bf-5e31-964b-d12a780c6b27 with identifier: AL33204
2026-03-28 12:06:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3225aaca-17bf-5e31-964b-d12a780c6b27 with scrape type 1
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3225aaca-17bf-5e31-964b-d12a780c6b27
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fb3%252Fc1b317ca2fd375282532e65a5130627f%252Fpa%252FAL33204_ec892f3db86504e522ec0947de3fb133.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_ec892f3db86504e522ec0947de3fb133.jpg not downloaded yet
2026-03-28 12:06:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d30fe5e-01e6-5e04-a30f-72906e911127 with identifier: UM38141
2026-03-28 12:06:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d30fe5e-01e6-5e04-a30f-72906e911127 with scrape type 1
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 4d30fe5e-01e6-5e04-a30f-72906e911127
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fc8%252F78c8994908530a10f2fa5ac5c83a0fc2%252Fpa%252FUM38141_0e5bb578f72cf5ad43f009a1cdeea1eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/c8/78c8994908530a10f2fa5ac5c83a0fc2/pa/UM38141_0e5bb578f72cf5ad43f009a1cdeea1eb.jpg not downloaded yet
2026-03-28 12:06:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 125b1a7b-6637-556f-aa40-9f9e3f8626e4 with identifier: HC79760
2026-03-28 12:06:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 125b1a7b-6637-556f-aa40-9f9e3f8626e4 with scrape type 1
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 125b1a7b-6637-556f-aa40-9f9e3f8626e4
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F11%252F8a11d4af41574889790bbae295c62423%252Fpa%252FHC79760_00ecc9de77dee3994b1623679e73adc3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_00ecc9de77dee3994b1623679e73adc3.jpg not downloaded yet
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F97%252Fa597a3d71076ca34f9a1fd745e8975d4%252Fpa%252FVU45167_4a06f37229ba05e807f72b59b6f8c6c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_4a06f37229ba05e807f72b59b6f8c6c9.jpg not downloaded yet
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F62%252Fdb62b21d8b75e15ca8777883db174739%252Fpa%252FVJ26511_2627b4766b6e5c41d40ea028818fa5ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_2627b4766b6e5c41d40ea028818fa5ff.jpg not downloaded yet
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fab%252F41abba4c065e15e533dd8e7a58ac874a%252Fpa%252FSZ93699_93a508b4866bac850f6245b2b532b402.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/ab/41abba4c065e15e533dd8e7a58ac874a/pa/SZ93699_93a508b4866bac850f6245b2b532b402.jpg not downloaded yet
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fb3%252Fc1b317ca2fd375282532e65a5130627f%252Fpa%252FAL33204_0b2a0b76afbcab350ac5e1efb14c5eca.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_0b2a0b76afbcab350ac5e1efb14c5eca.jpg not downloaded yet
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fc8%252F78c8994908530a10f2fa5ac5c83a0fc2%252Fpa%252FUM38141_2270882512715e147130c2461a424fef.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/c8/78c8994908530a10f2fa5ac5c83a0fc2/pa/UM38141_2270882512715e147130c2461a424fef.jpg not downloaded yet
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F11%252F8a11d4af41574889790bbae295c62423%252Fpa%252FHC79760_982ed81c120a1df7da41a5714e377516.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_982ed81c120a1df7da41a5714e377516.jpg not downloaded yet
2026-03-28 12:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EY62872> (referer: https://www.auto1.com/v1/car-details-view/EY62872/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F97%252Fa597a3d71076ca34f9a1fd745e8975d4%252Fpa%252FVU45167_0955b55d7431518482381adabff3285c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_0955b55d7431518482381adabff3285c.jpg not downloaded yet
2026-03-28 12:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YD14292> (referer: https://www.auto1.com/v1/car-details-view/YD14292/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F62%252Fdb62b21d8b75e15ca8777883db174739%252Fpa%252FVJ26511_2a7696a63446033ee12270a46e54cf7c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_2a7696a63446033ee12270a46e54cf7c.jpg not downloaded yet
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fb3%252Fc1b317ca2fd375282532e65a5130627f%252Fpa%252FAL33204_05c1cfebab3be390ab6d8f4012e481c4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_05c1cfebab3be390ab6d8f4012e481c4.jpg not downloaded yet
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fc8%252F78c8994908530a10f2fa5ac5c83a0fc2%252Fpa%252FUM38141_ff7ca03828c54f3b559801f03dfcaaec.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/c8/78c8994908530a10f2fa5ac5c83a0fc2/pa/UM38141_ff7ca03828c54f3b559801f03dfcaaec.jpg not downloaded yet
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F11%252F8a11d4af41574889790bbae295c62423%252Fpa%252FHC79760_fc1d565be24e2db7f3be708dbab3807c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_fc1d565be24e2db7f3be708dbab3807c.jpg not downloaded yet
2026-03-28 12:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5fdf50>
2026-03-28 12:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d7fc43-fb9d-5932-a17a-a2dbfd8793c0/73d7fc43-fb9d-5932-a17a-a2dbfd8793c0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fab%252F41abba4c065e15e533dd8e7a58ac874a%252Fpa%252FSZ93699_fa9a5beb01c7557501e675b270cb06c5.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/ab/41abba4c065e15e533dd8e7a58ac874a/pa/SZ93699_fa9a5beb01c7557501e675b270cb06c5.jpg saved to cache
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73d7fc43-fb9d-5932-a17a-a2dbfd8793c0
2026-03-28 12:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf665d0>
2026-03-28 12:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4e4cb87-df47-57e4-b8ad-6419a1fd3c07/b4e4cb87-df47-57e4-b8ad-6419a1fd3c07_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F62%252Fdb62b21d8b75e15ca8777883db174739%252Fpa%252FVJ26511_7d97a0062e77ad538c868167bf88f454.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_7d97a0062e77ad538c868167bf88f454.jpg saved to cache
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4e4cb87-df47-57e4-b8ad-6419a1fd3c07
2026-03-28 12:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc64f050>
2026-03-28 12:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99331b19-07da-57c2-8f19-2bf79e0ae01c/99331b19-07da-57c2-8f19-2bf79e0ae01c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fda%252F51dac849c5c7fed6fd1d19543af9859a%252Fpa%252FLC50167_08298882697f2fa719a1314a3d1ab4c9.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_08298882697f2fa719a1314a3d1ab4c9.jpg saved to cache
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 99331b19-07da-57c2-8f19-2bf79e0ae01c
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F97%252Fa597a3d71076ca34f9a1fd745e8975d4%252Fpa%252FVU45167_e979e6c155d24fed1b83b5b619f29103.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_e979e6c155d24fed1b83b5b619f29103.jpg not downloaded yet
2026-03-28 12:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_c9fc8f65caab6a749c188c88ee199f5f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F62%252Fdb62b21d8b75e15ca8777883db174739%252Fpa%252FVJ26511_219eed5c454f4dc5381eda12a545db59.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_219eed5c454f4dc5381eda12a545db59.jpg not downloaded yet
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fb3%252Fc1b317ca2fd375282532e65a5130627f%252Fpa%252FAL33204_23bbc4e13a7b0e3ce245715f5b62bb49.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_23bbc4e13a7b0e3ce245715f5b62bb49.jpg not downloaded yet
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fc8%252F78c8994908530a10f2fa5ac5c83a0fc2%252Fpa%252FUM38141_d6a16e8e5630e20c80cdf58b8f544eda.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/c8/78c8994908530a10f2fa5ac5c83a0fc2/pa/UM38141_d6a16e8e5630e20c80cdf58b8f544eda.jpg not downloaded yet
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F11%252F8a11d4af41574889790bbae295c62423%252Fpa%252FHC79760_1e807387effad6d08290427669720f92.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_1e807387effad6d08290427669720f92.jpg not downloaded yet
2026-03-28 12:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_90ba91690457ae4057cb86220a7e03bb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/ab/41abba4c065e15e533dd8e7a58ac874a/pa/SZ93699_8951091ffac4ed7131284583b9c04ac7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F97%252Fa597a3d71076ca34f9a1fd745e8975d4%252Fpa%252FVU45167_fffafc374460344fb5963c64f0d6d226.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_fffafc374460344fb5963c64f0d6d226.jpg not downloaded yet
2026-03-28 12:06:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0077dae7-9082-5831-b811-58838feecdff with identifier: EY62872
2026-03-28 12:06:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0077dae7-9082-5831-b811-58838feecdff with scrape type 1
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0077dae7-9082-5831-b811-58838feecdff
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb2%252Ff9b21d4809200a6d8c70a57b5ebcce99%252Fpa%252FEY62872_2640c9edecdf68081b30239e7dbd92f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_2640c9edecdf68081b30239e7dbd92f1.jpg not downloaded yet
2026-03-28 12:06:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 538ddd9a-147f-5bdf-b06d-ef0bff55e2ff with identifier: YD14292
2026-03-28 12:06:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 538ddd9a-147f-5bdf-b06d-ef0bff55e2ff with scrape type 1
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 538ddd9a-147f-5bdf-b06d-ef0bff55e2ff
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F73%252Fad733e6d919519082d2bf7512bd62450%252Fpa%252FYD14292_78e2db57de42b566b5cfccb8715ec6df.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_78e2db57de42b566b5cfccb8715ec6df.jpg not downloaded yet
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F62%252Fdb62b21d8b75e15ca8777883db174739%252Fpa%252FVJ26511_d35fc242d157e4a6311cd2d311d50976.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_d35fc242d157e4a6311cd2d311d50976.jpg not downloaded yet
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fb3%252Fc1b317ca2fd375282532e65a5130627f%252Fpa%252FAL33204_a2b4044cd08eac16d2861f31b75db3b2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_a2b4044cd08eac16d2861f31b75db3b2.jpg not downloaded yet
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fc8%252F78c8994908530a10f2fa5ac5c83a0fc2%252Fpa%252FUM38141_94d8d92ddde9d0c9fdf45c538eccc4af.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/c8/78c8994908530a10f2fa5ac5c83a0fc2/pa/UM38141_94d8d92ddde9d0c9fdf45c538eccc4af.jpg not downloaded yet
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F11%252F8a11d4af41574889790bbae295c62423%252Fpa%252FHC79760_1c7dd74b754e4a1c4d61eb92be9a1674.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_1c7dd74b754e4a1c4d61eb92be9a1674.jpg not downloaded yet
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F97%252Fa597a3d71076ca34f9a1fd745e8975d4%252Fpa%252FVU45167_52ec737b42e3f2fd8426e1350c56bce7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_52ec737b42e3f2fd8426e1350c56bce7.jpg not downloaded yet
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb2%252Ff9b21d4809200a6d8c70a57b5ebcce99%252Fpa%252FEY62872_45e422a6678fe70460a3868b60e7abed.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_45e422a6678fe70460a3868b60e7abed.jpg not downloaded yet
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F73%252Fad733e6d919519082d2bf7512bd62450%252Fpa%252FYD14292_6604ffcaef8f9cfdb00a66d462ca1173.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_6604ffcaef8f9cfdb00a66d462ca1173.jpg not downloaded yet
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F62%252Fdb62b21d8b75e15ca8777883db174739%252Fpa%252FVJ26511_66231fc5800739c9d50fdecdd74645d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_66231fc5800739c9d50fdecdd74645d4.jpg not downloaded yet
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fb3%252Fc1b317ca2fd375282532e65a5130627f%252Fpa%252FAL33204_189ac0f8e207cca595f9d4866bb0310a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_189ac0f8e207cca595f9d4866bb0310a.jpg not downloaded yet
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F11%252F8a11d4af41574889790bbae295c62423%252Fpa%252FHC79760_fdd50fe3b7e99c82ad8e1274cac84fbc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_fdd50fe3b7e99c82ad8e1274cac84fbc.jpg not downloaded yet
2026-03-28 12:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd155f10>
2026-03-28 12:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4e4cb87-df47-57e4-b8ad-6419a1fd3c07/b4e4cb87-df47-57e4-b8ad-6419a1fd3c07_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F62%252Fdb62b21d8b75e15ca8777883db174739%252Fpa%252FVJ26511_c9fc8f65caab6a749c188c88ee199f5f.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_c9fc8f65caab6a749c188c88ee199f5f.jpg saved to cache
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b4e4cb87-df47-57e4-b8ad-6419a1fd3c07
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F97%252Fa597a3d71076ca34f9a1fd745e8975d4%252Fpa%252FVU45167_7c68f6284b34de2d01bb07ddeaa67984.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_7c68f6284b34de2d01bb07ddeaa67984.jpg not downloaded yet
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb2%252Ff9b21d4809200a6d8c70a57b5ebcce99%252Fpa%252FEY62872_2e9e02210952dfc44fecfe2fe7c1d8b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_2e9e02210952dfc44fecfe2fe7c1d8b3.jpg not downloaded yet
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F73%252Fad733e6d919519082d2bf7512bd62450%252Fpa%252FYD14292_171caf71bd4488f1bc723ecc8e5da891.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_171caf71bd4488f1bc723ecc8e5da891.jpg not downloaded yet
2026-03-28 12:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_92486d378eb955640e14c23877876dee.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_8cb0107ab0c1959c3efa77165b672040.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fb3%252Fc1b317ca2fd375282532e65a5130627f%252Fpa%252FAL33204_25a9729cf8aee5c4c110a5e029e37ab7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_25a9729cf8aee5c4c110a5e029e37ab7.jpg not downloaded yet
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F11%252F8a11d4af41574889790bbae295c62423%252Fpa%252FHC79760_f842161d5daad8b64a0f51c5a98f686b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_f842161d5daad8b64a0f51c5a98f686b.jpg not downloaded yet
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc673810>
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99331b19-07da-57c2-8f19-2bf79e0ae01c/99331b19-07da-57c2-8f19-2bf79e0ae01c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fda%252F51dac849c5c7fed6fd1d19543af9859a%252Fpa%252FLC50167_90ba91690457ae4057cb86220a7e03bb.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_90ba91690457ae4057cb86220a7e03bb.jpg saved to cache
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 99331b19-07da-57c2-8f19-2bf79e0ae01c
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc57efd0>
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d7fc43-fb9d-5932-a17a-a2dbfd8793c0/73d7fc43-fb9d-5932-a17a-a2dbfd8793c0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fab%252F41abba4c065e15e533dd8e7a58ac874a%252Fpa%252FSZ93699_8951091ffac4ed7131284583b9c04ac7.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/ab/41abba4c065e15e533dd8e7a58ac874a/pa/SZ93699_8951091ffac4ed7131284583b9c04ac7.jpg saved to cache
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 73d7fc43-fb9d-5932-a17a-a2dbfd8793c0
2026-03-28 12:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_1baddf7e956269f5f572ec6d81b87470.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/ab/41abba4c065e15e533dd8e7a58ac874a/pa/SZ93699_02484abe86d729c17e35acd2a77cb84d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F97%252Fa597a3d71076ca34f9a1fd745e8975d4%252Fpa%252FVU45167_ab08134f2b1ad24a55edccde29cd640b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_ab08134f2b1ad24a55edccde29cd640b.jpg not downloaded yet
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb2%252Ff9b21d4809200a6d8c70a57b5ebcce99%252Fpa%252FEY62872_e8cfd6c7a4fd92553fdcfef40c1c41af.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_e8cfd6c7a4fd92553fdcfef40c1c41af.jpg not downloaded yet
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F73%252Fad733e6d919519082d2bf7512bd62450%252Fpa%252FYD14292_d3f5bcd4801a25daa14581aa85e95a53.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_d3f5bcd4801a25daa14581aa85e95a53.jpg not downloaded yet
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fb3%252Fc1b317ca2fd375282532e65a5130627f%252Fpa%252FAL33204_394f119855b3628de9eb326c083df8b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_394f119855b3628de9eb326c083df8b1.jpg not downloaded yet
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F11%252F8a11d4af41574889790bbae295c62423%252Fpa%252FHC79760_624d04f589879d06c26d50edb183f035.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_624d04f589879d06c26d50edb183f035.jpg not downloaded yet
2026-03-28 12:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EU57494> (referer: https://www.auto1.com/v1/car-details-view/EU57494/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_982ed81c120a1df7da41a5714e377516.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb2%252Ff9b21d4809200a6d8c70a57b5ebcce99%252Fpa%252FEY62872_7af143096ba37927c5f1a8521dfd1e96.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_7af143096ba37927c5f1a8521dfd1e96.jpg not downloaded yet
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F73%252Fad733e6d919519082d2bf7512bd62450%252Fpa%252FYD14292_ca923b914fe41eb9ad4d77ffc9d348bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_ca923b914fe41eb9ad4d77ffc9d348bf.jpg not downloaded yet
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc429750>
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4e4cb87-df47-57e4-b8ad-6419a1fd3c07/b4e4cb87-df47-57e4-b8ad-6419a1fd3c07_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F62%252Fdb62b21d8b75e15ca8777883db174739%252Fpa%252FVJ26511_92486d378eb955640e14c23877876dee.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_92486d378eb955640e14c23877876dee.jpg saved to cache
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b4e4cb87-df47-57e4-b8ad-6419a1fd3c07
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd0ff790>
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99331b19-07da-57c2-8f19-2bf79e0ae01c/99331b19-07da-57c2-8f19-2bf79e0ae01c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fda%252F51dac849c5c7fed6fd1d19543af9859a%252Fpa%252FLC50167_8cb0107ab0c1959c3efa77165b672040.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_8cb0107ab0c1959c3efa77165b672040.jpg saved to cache
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 99331b19-07da-57c2-8f19-2bf79e0ae01c
2026-03-28 12:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_fc1d565be24e2db7f3be708dbab3807c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fb3%252Fc1b317ca2fd375282532e65a5130627f%252Fpa%252FAL33204_5d2d94c402ded8cf0b528ee341a34414.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_5d2d94c402ded8cf0b528ee341a34414.jpg not downloaded yet
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F11%252F8a11d4af41574889790bbae295c62423%252Fpa%252FHC79760_1135effdacbcc1807d45de740a962a18.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_1135effdacbcc1807d45de740a962a18.jpg not downloaded yet
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb2%252Ff9b21d4809200a6d8c70a57b5ebcce99%252Fpa%252FEY62872_e54acd6c631aa8c4e7fa91b6ff4b8d64.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_e54acd6c631aa8c4e7fa91b6ff4b8d64.jpg not downloaded yet
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F73%252Fad733e6d919519082d2bf7512bd62450%252Fpa%252FYD14292_3efc7a4f8f3ffd7575f95d00bc0bd06d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_3efc7a4f8f3ffd7575f95d00bc0bd06d.jpg not downloaded yet
2026-03-28 12:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/c8/78c8994908530a10f2fa5ac5c83a0fc2/pa/UM38141_2270882512715e147130c2461a424fef.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fb3%252Fc1b317ca2fd375282532e65a5130627f%252Fpa%252FAL33204_4e6f396cbd7ebdd1c1a9f7353c665f47.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_4e6f396cbd7ebdd1c1a9f7353c665f47.jpg not downloaded yet
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F11%252F8a11d4af41574889790bbae295c62423%252Fpa%252FHC79760_b9e340f7a28420a51df7733db063893f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_b9e340f7a28420a51df7733db063893f.jpg not downloaded yet
2026-03-28 12:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3b2e10>
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b437e8b-a37a-53ec-8205-69705c9ab3cb/5b437e8b-a37a-53ec-8205-69705c9ab3cb_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F39%252F8a39ab45a3258320dc9f2f2ca4330fea%252Fpa%252FDV86201_1baddf7e956269f5f572ec6d81b87470.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_1baddf7e956269f5f572ec6d81b87470.jpg saved to cache
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5b437e8b-a37a-53ec-8205-69705c9ab3cb
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3c7c10>
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d7fc43-fb9d-5932-a17a-a2dbfd8793c0/73d7fc43-fb9d-5932-a17a-a2dbfd8793c0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fab%252F41abba4c065e15e533dd8e7a58ac874a%252Fpa%252FSZ93699_02484abe86d729c17e35acd2a77cb84d.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/ab/41abba4c065e15e533dd8e7a58ac874a/pa/SZ93699_02484abe86d729c17e35acd2a77cb84d.jpg saved to cache
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 73d7fc43-fb9d-5932-a17a-a2dbfd8793c0
2026-03-28 12:06:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a8b502f-6ccc-5483-9df0-0972dbb8f3d9 with identifier: EU57494
2026-03-28 12:06:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a8b502f-6ccc-5483-9df0-0972dbb8f3d9 with scrape type 1
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4a8b502f-6ccc-5483-9df0-0972dbb8f3d9
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a05ec4e33e66f0cb5ad199c354bcfb%252Fpa%252FEU57494_9cae8c2fc0ff64d349499d3ee42f76ab.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_9cae8c2fc0ff64d349499d3ee42f76ab.jpg not downloaded yet
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bef2d0d0>
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_125b1a7b-6637-556f-aa40-9f9e3f8626e4/125b1a7b-6637-556f-aa40-9f9e3f8626e4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F11%252F8a11d4af41574889790bbae295c62423%252Fpa%252FHC79760_982ed81c120a1df7da41a5714e377516.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_982ed81c120a1df7da41a5714e377516.jpg saved to cache
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 125b1a7b-6637-556f-aa40-9f9e3f8626e4
2026-03-28 12:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_fdd50fe3b7e99c82ad8e1274cac84fbc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb2%252Ff9b21d4809200a6d8c70a57b5ebcce99%252Fpa%252FEY62872_f17852d84a0775321cf96f8c656cfdb8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_f17852d84a0775321cf96f8c656cfdb8.jpg not downloaded yet
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F73%252Fad733e6d919519082d2bf7512bd62450%252Fpa%252FYD14292_d85249778ded3cd650f1f35ca79b5136.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_d85249778ded3cd650f1f35ca79b5136.jpg not downloaded yet
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a05ec4e33e66f0cb5ad199c354bcfb%252Fpa%252FEU57494_369eeee529c3113e2241a600636654a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_369eeee529c3113e2241a600636654a5.jpg not downloaded yet
2026-03-28 12:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/c8/78c8994908530a10f2fa5ac5c83a0fc2/pa/UM38141_ff7ca03828c54f3b559801f03dfcaaec.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb2%252Ff9b21d4809200a6d8c70a57b5ebcce99%252Fpa%252FEY62872_acaf2002b67bfc37c15cc3e87c9c86a8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_acaf2002b67bfc37c15cc3e87c9c86a8.jpg not downloaded yet
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F73%252Fad733e6d919519082d2bf7512bd62450%252Fpa%252FYD14292_e6efcccd127c5ffe06e4ece03890dc6e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_e6efcccd127c5ffe06e4ece03890dc6e.jpg not downloaded yet
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3f4f10>
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_125b1a7b-6637-556f-aa40-9f9e3f8626e4/125b1a7b-6637-556f-aa40-9f9e3f8626e4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F11%252F8a11d4af41574889790bbae295c62423%252Fpa%252FHC79760_fc1d565be24e2db7f3be708dbab3807c.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_fc1d565be24e2db7f3be708dbab3807c.jpg saved to cache
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 125b1a7b-6637-556f-aa40-9f9e3f8626e4
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf35310>
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d30fe5e-01e6-5e04-a30f-72906e911127/4d30fe5e-01e6-5e04-a30f-72906e911127_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fc8%252F78c8994908530a10f2fa5ac5c83a0fc2%252Fpa%252FUM38141_2270882512715e147130c2461a424fef.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/c8/78c8994908530a10f2fa5ac5c83a0fc2/pa/UM38141_2270882512715e147130c2461a424fef.jpg saved to cache
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4d30fe5e-01e6-5e04-a30f-72906e911127
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a05ec4e33e66f0cb5ad199c354bcfb%252Fpa%252FEU57494_2413aea49adc4fde8c2abdd1953af3bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_2413aea49adc4fde8c2abdd1953af3bf.jpg not downloaded yet
2026-03-28 12:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SM49398> (referer: https://www.auto1.com/v1/car-details-view/SM49398/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_189ac0f8e207cca595f9d4866bb0310a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb2%252Ff9b21d4809200a6d8c70a57b5ebcce99%252Fpa%252FEY62872_981a51de3a84cb55a977e4b2a9526581.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_981a51de3a84cb55a977e4b2a9526581.jpg not downloaded yet
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F73%252Fad733e6d919519082d2bf7512bd62450%252Fpa%252FYD14292_d134bfd7eb19486222228363d8bfb8d5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_d134bfd7eb19486222228363d8bfb8d5.jpg not downloaded yet
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a05ec4e33e66f0cb5ad199c354bcfb%252Fpa%252FEU57494_99e058d6e1aee03a08ddc9a9552a3950.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_99e058d6e1aee03a08ddc9a9552a3950.jpg not downloaded yet
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3f5ad0>
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_125b1a7b-6637-556f-aa40-9f9e3f8626e4/125b1a7b-6637-556f-aa40-9f9e3f8626e4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F11%252F8a11d4af41574889790bbae295c62423%252Fpa%252FHC79760_fdd50fe3b7e99c82ad8e1274cac84fbc.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_fdd50fe3b7e99c82ad8e1274cac84fbc.jpg saved to cache
2026-03-28 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 125b1a7b-6637-556f-aa40-9f9e3f8626e4
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3b43d0>
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d30fe5e-01e6-5e04-a30f-72906e911127/4d30fe5e-01e6-5e04-a30f-72906e911127_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fc8%252F78c8994908530a10f2fa5ac5c83a0fc2%252Fpa%252FUM38141_ff7ca03828c54f3b559801f03dfcaaec.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/c8/78c8994908530a10f2fa5ac5c83a0fc2/pa/UM38141_ff7ca03828c54f3b559801f03dfcaaec.jpg saved to cache
2026-03-28 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4d30fe5e-01e6-5e04-a30f-72906e911127
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb2%252Ff9b21d4809200a6d8c70a57b5ebcce99%252Fpa%252FEY62872_13e038536252e99723b7c61535d2e570.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_13e038536252e99723b7c61535d2e570.jpg not downloaded yet
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F73%252Fad733e6d919519082d2bf7512bd62450%252Fpa%252FYD14292_a7343bf1e1a978d3bcee49935b798044.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_a7343bf1e1a978d3bcee49935b798044.jpg not downloaded yet
2026-03-28 12:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_b90faeefcf617870a5f03b2d68d0a701.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a05ec4e33e66f0cb5ad199c354bcfb%252Fpa%252FEU57494_413bbc5e9cb1807992298c3408518fb2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_413bbc5e9cb1807992298c3408518fb2.jpg not downloaded yet
2026-03-28 12:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_2e9e02210952dfc44fecfe2fe7c1d8b3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a05ec4e33e66f0cb5ad199c354bcfb%252Fpa%252FEU57494_f3cab75a00241c63563178ebb897d454.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_f3cab75a00241c63563178ebb897d454.jpg not downloaded yet
2026-03-28 12:06:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4defba85-a8b4-560e-9861-f282e4eff9d0 with identifier: SM49398
2026-03-28 12:06:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4defba85-a8b4-560e-9861-f282e4eff9d0 with scrape type 1
2026-03-28 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 4defba85-a8b4-560e-9861-f282e4eff9d0
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fae%252F9baeed2dedbeb009622f1982207117c4%252Fpa%252FSM49398_01fd030943e04cad5a3fcffb7e400057.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ae/9baeed2dedbeb009622f1982207117c4/pa/SM49398_01fd030943e04cad5a3fcffb7e400057.jpg not downloaded yet
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04beec8410>
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3225aaca-17bf-5e31-964b-d12a780c6b27/3225aaca-17bf-5e31-964b-d12a780c6b27_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fb3%252Fc1b317ca2fd375282532e65a5130627f%252Fpa%252FAL33204_189ac0f8e207cca595f9d4866bb0310a.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_189ac0f8e207cca595f9d4866bb0310a.jpg saved to cache
2026-03-28 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3225aaca-17bf-5e31-964b-d12a780c6b27
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a05ec4e33e66f0cb5ad199c354bcfb%252Fpa%252FEU57494_9539c40da686f649d76f201bebc93d1d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_9539c40da686f649d76f201bebc93d1d.jpg not downloaded yet
2026-03-28 12:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_624d04f589879d06c26d50edb183f035.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fae%252F9baeed2dedbeb009622f1982207117c4%252Fpa%252FSM49398_a070704d28f71e004748b79a0ffa113c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ae/9baeed2dedbeb009622f1982207117c4/pa/SM49398_a070704d28f71e004748b79a0ffa113c.jpg not downloaded yet
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a05ec4e33e66f0cb5ad199c354bcfb%252Fpa%252FEU57494_2f0728264b718f93083788e1fd006980.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_2f0728264b718f93083788e1fd006980.jpg not downloaded yet
2026-03-28 12:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3c86d0>
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99331b19-07da-57c2-8f19-2bf79e0ae01c/99331b19-07da-57c2-8f19-2bf79e0ae01c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fda%252F51dac849c5c7fed6fd1d19543af9859a%252Fpa%252FLC50167_b90faeefcf617870a5f03b2d68d0a701.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_b90faeefcf617870a5f03b2d68d0a701.jpg saved to cache
2026-03-28 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 99331b19-07da-57c2-8f19-2bf79e0ae01c
2026-03-28 12:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_2d70c3213205872e90ec23134916d59d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_35f44843d72d7338ee4cedfdc6243d29.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fae%252F9baeed2dedbeb009622f1982207117c4%252Fpa%252FSM49398_68b290f12a902be605bf6aa3bfc3cfcb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ae/9baeed2dedbeb009622f1982207117c4/pa/SM49398_68b290f12a902be605bf6aa3bfc3cfcb.jpg not downloaded yet
2026-03-28 12:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_e95bfc8b4f261cb48e2115cd3497e7f3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a05ec4e33e66f0cb5ad199c354bcfb%252Fpa%252FEU57494_a329b58b1bc37b34ce678284f896244e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_a329b58b1bc37b34ce678284f896244e.jpg not downloaded yet
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fae%252F9baeed2dedbeb009622f1982207117c4%252Fpa%252FSM49398_5eba7ea242deef104c79f490e6a149d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ae/9baeed2dedbeb009622f1982207117c4/pa/SM49398_5eba7ea242deef104c79f490e6a149d7.jpg not downloaded yet
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bceef8d0>
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0077dae7-9082-5831-b811-58838feecdff/0077dae7-9082-5831-b811-58838feecdff_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb2%252Ff9b21d4809200a6d8c70a57b5ebcce99%252Fpa%252FEY62872_2e9e02210952dfc44fecfe2fe7c1d8b3.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_2e9e02210952dfc44fecfe2fe7c1d8b3.jpg saved to cache
2026-03-28 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0077dae7-9082-5831-b811-58838feecdff
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc600090>
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_125b1a7b-6637-556f-aa40-9f9e3f8626e4/125b1a7b-6637-556f-aa40-9f9e3f8626e4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F11%252F8a11d4af41574889790bbae295c62423%252Fpa%252FHC79760_624d04f589879d06c26d50edb183f035.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_624d04f589879d06c26d50edb183f035.jpg saved to cache
2026-03-28 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 125b1a7b-6637-556f-aa40-9f9e3f8626e4
2026-03-28 12:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_1135effdacbcc1807d45de740a962a18.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a05ec4e33e66f0cb5ad199c354bcfb%252Fpa%252FEU57494_c7d1a1267dc7bf36f858c57ad104b0f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_c7d1a1267dc7bf36f858c57ad104b0f9.jpg not downloaded yet
2026-03-28 12:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_d85249778ded3cd650f1f35ca79b5136.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_3efc7a4f8f3ffd7575f95d00bc0bd06d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fae%252F9baeed2dedbeb009622f1982207117c4%252Fpa%252FSM49398_862ce482e684c61b3f9155a6756bbe89.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ae/9baeed2dedbeb009622f1982207117c4/pa/SM49398_862ce482e684c61b3f9155a6756bbe89.jpg not downloaded yet
2026-03-28 12:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc65e0d0>
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99331b19-07da-57c2-8f19-2bf79e0ae01c/99331b19-07da-57c2-8f19-2bf79e0ae01c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fda%252F51dac849c5c7fed6fd1d19543af9859a%252Fpa%252FLC50167_2d70c3213205872e90ec23134916d59d.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_2d70c3213205872e90ec23134916d59d.jpg saved to cache
2026-03-28 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 99331b19-07da-57c2-8f19-2bf79e0ae01c
2026-03-28 12:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3820d0>
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b437e8b-a37a-53ec-8205-69705c9ab3cb/5b437e8b-a37a-53ec-8205-69705c9ab3cb_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F39%252F8a39ab45a3258320dc9f2f2ca4330fea%252Fpa%252FDV86201_35f44843d72d7338ee4cedfdc6243d29.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_35f44843d72d7338ee4cedfdc6243d29.jpg saved to cache
2026-03-28 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5b437e8b-a37a-53ec-8205-69705c9ab3cb
2026-03-28 12:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc573250>
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99331b19-07da-57c2-8f19-2bf79e0ae01c/99331b19-07da-57c2-8f19-2bf79e0ae01c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fda%252F51dac849c5c7fed6fd1d19543af9859a%252Fpa%252FLC50167_e95bfc8b4f261cb48e2115cd3497e7f3.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_e95bfc8b4f261cb48e2115cd3497e7f3.jpg saved to cache
2026-03-28 12:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 99331b19-07da-57c2-8f19-2bf79e0ae01c
2026-03-28 12:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_e6efcccd127c5ffe06e4ece03890dc6e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_acaf2002b67bfc37c15cc3e87c9c86a8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc275290>
2026-03-28 12:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_125b1a7b-6637-556f-aa40-9f9e3f8626e4/125b1a7b-6637-556f-aa40-9f9e3f8626e4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F11%252F8a11d4af41574889790bbae295c62423%252Fpa%252FHC79760_1135effdacbcc1807d45de740a962a18.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_1135effdacbcc1807d45de740a962a18.jpg saved to cache
2026-03-28 12:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 125b1a7b-6637-556f-aa40-9f9e3f8626e4
2026-03-28 12:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc66a110>
2026-03-28 12:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_538ddd9a-147f-5bdf-b06d-ef0bff55e2ff/538ddd9a-147f-5bdf-b06d-ef0bff55e2ff_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F73%252Fad733e6d919519082d2bf7512bd62450%252Fpa%252FYD14292_d85249778ded3cd650f1f35ca79b5136.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_d85249778ded3cd650f1f35ca79b5136.jpg saved to cache
2026-03-28 12:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 538ddd9a-147f-5bdf-b06d-ef0bff55e2ff
2026-03-28 12:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bce99390>
2026-03-28 12:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_538ddd9a-147f-5bdf-b06d-ef0bff55e2ff/538ddd9a-147f-5bdf-b06d-ef0bff55e2ff_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F73%252Fad733e6d919519082d2bf7512bd62450%252Fpa%252FYD14292_3efc7a4f8f3ffd7575f95d00bc0bd06d.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_3efc7a4f8f3ffd7575f95d00bc0bd06d.jpg saved to cache
2026-03-28 12:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 538ddd9a-147f-5bdf-b06d-ef0bff55e2ff
2026-03-28 12:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_99e058d6e1aee03a08ddc9a9552a3950.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_a7343bf1e1a978d3bcee49935b798044.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcea4750>
2026-03-28 12:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_538ddd9a-147f-5bdf-b06d-ef0bff55e2ff/538ddd9a-147f-5bdf-b06d-ef0bff55e2ff_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F73%252Fad733e6d919519082d2bf7512bd62450%252Fpa%252FYD14292_e6efcccd127c5ffe06e4ece03890dc6e.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_e6efcccd127c5ffe06e4ece03890dc6e.jpg saved to cache
2026-03-28 12:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 538ddd9a-147f-5bdf-b06d-ef0bff55e2ff
2026-03-28 12:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3b1e10>
2026-03-28 12:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0077dae7-9082-5831-b811-58838feecdff/0077dae7-9082-5831-b811-58838feecdff_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb2%252Ff9b21d4809200a6d8c70a57b5ebcce99%252Fpa%252FEY62872_acaf2002b67bfc37c15cc3e87c9c86a8.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_acaf2002b67bfc37c15cc3e87c9c86a8.jpg saved to cache
2026-03-28 12:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0077dae7-9082-5831-b811-58838feecdff
2026-03-28 12:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_e979e6c155d24fed1b83b5b619f29103.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_c7d1a1267dc7bf36f858c57ad104b0f9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_9539c40da686f649d76f201bebc93d1d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfbd410>
2026-03-28 12:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a8b502f-6ccc-5483-9df0-0972dbb8f3d9/4a8b502f-6ccc-5483-9df0-0972dbb8f3d9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a05ec4e33e66f0cb5ad199c354bcfb%252Fpa%252FEU57494_99e058d6e1aee03a08ddc9a9552a3950.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_99e058d6e1aee03a08ddc9a9552a3950.jpg saved to cache
2026-03-28 12:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4a8b502f-6ccc-5483-9df0-0972dbb8f3d9
2026-03-28 12:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5e5890>
2026-03-28 12:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_538ddd9a-147f-5bdf-b06d-ef0bff55e2ff/538ddd9a-147f-5bdf-b06d-ef0bff55e2ff_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F73%252Fad733e6d919519082d2bf7512bd62450%252Fpa%252FYD14292_a7343bf1e1a978d3bcee49935b798044.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_a7343bf1e1a978d3bcee49935b798044.jpg saved to cache
2026-03-28 12:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 538ddd9a-147f-5bdf-b06d-ef0bff55e2ff
2026-03-28 12:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/ae/9baeed2dedbeb009622f1982207117c4/pa/SM49398_5eba7ea242deef104c79f490e6a149d7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_171caf71bd4488f1bc723ecc8e5da891.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/ae/9baeed2dedbeb009622f1982207117c4/pa/SM49398_862ce482e684c61b3f9155a6756bbe89.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_a329b58b1bc37b34ce678284f896244e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_2f0728264b718f93083788e1fd006980.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/ae/9baeed2dedbeb009622f1982207117c4/pa/SM49398_68b290f12a902be605bf6aa3bfc3cfcb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_d3f5bcd4801a25daa14581aa85e95a53.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3b0890>
2026-03-28 12:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f35d65-c75a-544a-bcc6-29d77a5b267f/30f35d65-c75a-544a-bcc6-29d77a5b267f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F97%252Fa597a3d71076ca34f9a1fd745e8975d4%252Fpa%252FVU45167_e979e6c155d24fed1b83b5b619f29103.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_e979e6c155d24fed1b83b5b619f29103.jpg saved to cache
2026-03-28 12:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 30f35d65-c75a-544a-bcc6-29d77a5b267f
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bced6550>
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a8b502f-6ccc-5483-9df0-0972dbb8f3d9/4a8b502f-6ccc-5483-9df0-0972dbb8f3d9_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a05ec4e33e66f0cb5ad199c354bcfb%252Fpa%252FEU57494_c7d1a1267dc7bf36f858c57ad104b0f9.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_c7d1a1267dc7bf36f858c57ad104b0f9.jpg saved to cache
2026-03-28 12:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4a8b502f-6ccc-5483-9df0-0972dbb8f3d9
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5ff050>
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a8b502f-6ccc-5483-9df0-0972dbb8f3d9/4a8b502f-6ccc-5483-9df0-0972dbb8f3d9_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a05ec4e33e66f0cb5ad199c354bcfb%252Fpa%252FEU57494_9539c40da686f649d76f201bebc93d1d.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_9539c40da686f649d76f201bebc93d1d.jpg saved to cache
2026-03-28 12:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4a8b502f-6ccc-5483-9df0-0972dbb8f3d9
2026-03-28 12:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_413bbc5e9cb1807992298c3408518fb2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/ae/9baeed2dedbeb009622f1982207117c4/pa/SM49398_01fd030943e04cad5a3fcffb7e400057.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_d134bfd7eb19486222228363d8bfb8d5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/ae/9baeed2dedbeb009622f1982207117c4/pa/SM49398_a070704d28f71e004748b79a0ffa113c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_f3cab75a00241c63563178ebb897d454.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_e8cfd6c7a4fd92553fdcfef40c1c41af.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3e2cd0>
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4defba85-a8b4-560e-9861-f282e4eff9d0/4defba85-a8b4-560e-9861-f282e4eff9d0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fae%252F9baeed2dedbeb009622f1982207117c4%252Fpa%252FSM49398_5eba7ea242deef104c79f490e6a149d7.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ae/9baeed2dedbeb009622f1982207117c4/pa/SM49398_5eba7ea242deef104c79f490e6a149d7.jpg saved to cache
2026-03-28 12:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4defba85-a8b4-560e-9861-f282e4eff9d0
2026-03-28 12:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcee5750>
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_538ddd9a-147f-5bdf-b06d-ef0bff55e2ff/538ddd9a-147f-5bdf-b06d-ef0bff55e2ff_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F73%252Fad733e6d919519082d2bf7512bd62450%252Fpa%252FYD14292_171caf71bd4488f1bc723ecc8e5da891.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_171caf71bd4488f1bc723ecc8e5da891.jpg saved to cache
2026-03-28 12:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 538ddd9a-147f-5bdf-b06d-ef0bff55e2ff
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bee857d0>
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4defba85-a8b4-560e-9861-f282e4eff9d0/4defba85-a8b4-560e-9861-f282e4eff9d0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fae%252F9baeed2dedbeb009622f1982207117c4%252Fpa%252FSM49398_862ce482e684c61b3f9155a6756bbe89.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ae/9baeed2dedbeb009622f1982207117c4/pa/SM49398_862ce482e684c61b3f9155a6756bbe89.jpg saved to cache
2026-03-28 12:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4defba85-a8b4-560e-9861-f282e4eff9d0
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc457c10>
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a8b502f-6ccc-5483-9df0-0972dbb8f3d9/4a8b502f-6ccc-5483-9df0-0972dbb8f3d9_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a05ec4e33e66f0cb5ad199c354bcfb%252Fpa%252FEU57494_a329b58b1bc37b34ce678284f896244e.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_a329b58b1bc37b34ce678284f896244e.jpg saved to cache
2026-03-28 12:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4a8b502f-6ccc-5483-9df0-0972dbb8f3d9
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd072150>
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a8b502f-6ccc-5483-9df0-0972dbb8f3d9/4a8b502f-6ccc-5483-9df0-0972dbb8f3d9_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a05ec4e33e66f0cb5ad199c354bcfb%252Fpa%252FEU57494_2f0728264b718f93083788e1fd006980.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_2f0728264b718f93083788e1fd006980.jpg saved to cache
2026-03-28 12:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4a8b502f-6ccc-5483-9df0-0972dbb8f3d9
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf31c10>
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4defba85-a8b4-560e-9861-f282e4eff9d0/4defba85-a8b4-560e-9861-f282e4eff9d0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fae%252F9baeed2dedbeb009622f1982207117c4%252Fpa%252FSM49398_68b290f12a902be605bf6aa3bfc3cfcb.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ae/9baeed2dedbeb009622f1982207117c4/pa/SM49398_68b290f12a902be605bf6aa3bfc3cfcb.jpg saved to cache
2026-03-28 12:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4defba85-a8b4-560e-9861-f282e4eff9d0
2026-03-28 12:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc42b110>
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_538ddd9a-147f-5bdf-b06d-ef0bff55e2ff/538ddd9a-147f-5bdf-b06d-ef0bff55e2ff_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F73%252Fad733e6d919519082d2bf7512bd62450%252Fpa%252FYD14292_d3f5bcd4801a25daa14581aa85e95a53.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_d3f5bcd4801a25daa14581aa85e95a53.jpg saved to cache
2026-03-28 12:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 538ddd9a-147f-5bdf-b06d-ef0bff55e2ff
2026-03-28 12:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_b9e340f7a28420a51df7733db063893f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_2413aea49adc4fde8c2abdd1953af3bf.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_981a51de3a84cb55a977e4b2a9526581.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_369eeee529c3113e2241a600636654a5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc4553d0>
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a8b502f-6ccc-5483-9df0-0972dbb8f3d9/4a8b502f-6ccc-5483-9df0-0972dbb8f3d9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a05ec4e33e66f0cb5ad199c354bcfb%252Fpa%252FEU57494_413bbc5e9cb1807992298c3408518fb2.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_413bbc5e9cb1807992298c3408518fb2.jpg saved to cache
2026-03-28 12:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4a8b502f-6ccc-5483-9df0-0972dbb8f3d9
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3e37d0>
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4defba85-a8b4-560e-9861-f282e4eff9d0/4defba85-a8b4-560e-9861-f282e4eff9d0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fae%252F9baeed2dedbeb009622f1982207117c4%252Fpa%252FSM49398_01fd030943e04cad5a3fcffb7e400057.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ae/9baeed2dedbeb009622f1982207117c4/pa/SM49398_01fd030943e04cad5a3fcffb7e400057.jpg saved to cache
2026-03-28 12:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4defba85-a8b4-560e-9861-f282e4eff9d0
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3d66d0>
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_538ddd9a-147f-5bdf-b06d-ef0bff55e2ff/538ddd9a-147f-5bdf-b06d-ef0bff55e2ff_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F73%252Fad733e6d919519082d2bf7512bd62450%252Fpa%252FYD14292_d134bfd7eb19486222228363d8bfb8d5.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_d134bfd7eb19486222228363d8bfb8d5.jpg saved to cache
2026-03-28 12:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 538ddd9a-147f-5bdf-b06d-ef0bff55e2ff
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc38c350>
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4defba85-a8b4-560e-9861-f282e4eff9d0/4defba85-a8b4-560e-9861-f282e4eff9d0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fae%252F9baeed2dedbeb009622f1982207117c4%252Fpa%252FSM49398_a070704d28f71e004748b79a0ffa113c.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ae/9baeed2dedbeb009622f1982207117c4/pa/SM49398_a070704d28f71e004748b79a0ffa113c.jpg saved to cache
2026-03-28 12:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4defba85-a8b4-560e-9861-f282e4eff9d0
2026-03-28 12:06:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4defba85-a8b4-560e-9861-f282e4eff9d0, skipping ID generation
2026-03-28 12:06:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4defba85-a8b4-560e-9861-f282e4eff9d0 with scrape type 1
2026-03-28 12:06:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4defba85-a8b4-560e-9861-f282e4eff9d0 sending to next pipeline
2026-03-28 12:06:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4defba85-a8b4-560e-9861-f282e4eff9d0, identifier: SM49398
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcead550>
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a8b502f-6ccc-5483-9df0-0972dbb8f3d9/4a8b502f-6ccc-5483-9df0-0972dbb8f3d9_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a05ec4e33e66f0cb5ad199c354bcfb%252Fpa%252FEU57494_f3cab75a00241c63563178ebb897d454.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_f3cab75a00241c63563178ebb897d454.jpg saved to cache
2026-03-28 12:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4a8b502f-6ccc-5483-9df0-0972dbb8f3d9
2026-03-28 12:06:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5e7250>
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0077dae7-9082-5831-b811-58838feecdff/0077dae7-9082-5831-b811-58838feecdff_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb2%252Ff9b21d4809200a6d8c70a57b5ebcce99%252Fpa%252FEY62872_e8cfd6c7a4fd92553fdcfef40c1c41af.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_e8cfd6c7a4fd92553fdcfef40c1c41af.jpg saved to cache
2026-03-28 12:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0077dae7-9082-5831-b811-58838feecdff
2026-03-28 12:06:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4defba85-a8b4-560e-9861-f282e4eff9d0 with identifier: SM49398
2026-03-28 12:06:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4defba85-a8b4-560e-9861-f282e4eff9d0 with identifier: SM49398
2026-03-28 12:06:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4defba85-a8b4-560e-9861-f282e4eff9d0 with identifier: SM49398 to the API
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9b/ae/9baeed2dedbeb009622f1982207117c4/pa/SM49398_a070704d28f71e004748b79a0ffa113c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.1L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:54:44Z',
 'fuel_type': 'diesel',
 'id': '4defba85-a8b4-560e-9861-f282e4eff9d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM49398',
 'listing': 'auction',
 'location': 'IT, Navacchio',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 375010,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4defba85-a8b4-560e-9861-f282e4eff9d0/4defba85-a8b4-560e-9861-f282e4eff9d0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/ae/9baeed2dedbeb009622f1982207117c4/pa/SM49398_01fd030943e04cad5a3fcffb7e400057.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4defba85-a8b4-560e-9861-f282e4eff9d0/4defba85-a8b4-560e-9861-f282e4eff9d0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/ae/9baeed2dedbeb009622f1982207117c4/pa/SM49398_a070704d28f71e004748b79a0ffa113c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4defba85-a8b4-560e-9861-f282e4eff9d0/4defba85-a8b4-560e-9861-f282e4eff9d0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/ae/9baeed2dedbeb009622f1982207117c4/pa/SM49398_68b290f12a902be605bf6aa3bfc3cfcb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4defba85-a8b4-560e-9861-f282e4eff9d0/4defba85-a8b4-560e-9861-f282e4eff9d0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74609,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/ae/9baeed2dedbeb009622f1982207117c4/pa/SM49398_5eba7ea242deef104c79f490e6a149d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4defba85-a8b4-560e-9861-f282e4eff9d0/4defba85-a8b4-560e-9861-f282e4eff9d0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/ae/9baeed2dedbeb009622f1982207117c4/pa/SM49398_862ce482e684c61b3f9155a6756bbe89.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2002-08-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI Avantgarde',
 'transmission': 'manual',
 'trim': 'Avantgarde',
 'year': 2002}
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM49398%27 HTTP/1.1" 200 None
2026-03-28 12:06:27 [auto1.it] INFO: Saving data for SM49398: {'created_time': 1774699587.675376, 'last_price_update_time': 1774699587.675386, 'auction_closing_time': 1774886084.0}
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SM49398') HTTP/1.1" 204 0
2026-03-28 12:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_e54acd6c631aa8c4e7fa91b6ff4b8d64.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_5d2d94c402ded8cf0b528ee341a34414.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_7af143096ba37927c5f1a8521dfd1e96.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DU34377> (referer: https://www.auto1.com/v1/car-details-view/DU34377/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3a8250>
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_125b1a7b-6637-556f-aa40-9f9e3f8626e4/125b1a7b-6637-556f-aa40-9f9e3f8626e4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F11%252F8a11d4af41574889790bbae295c62423%252Fpa%252FHC79760_b9e340f7a28420a51df7733db063893f.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_b9e340f7a28420a51df7733db063893f.jpg saved to cache
2026-03-28 12:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 125b1a7b-6637-556f-aa40-9f9e3f8626e4
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04beed8190>
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a8b502f-6ccc-5483-9df0-0972dbb8f3d9/4a8b502f-6ccc-5483-9df0-0972dbb8f3d9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a05ec4e33e66f0cb5ad199c354bcfb%252Fpa%252FEU57494_2413aea49adc4fde8c2abdd1953af3bf.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_2413aea49adc4fde8c2abdd1953af3bf.jpg saved to cache
2026-03-28 12:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4a8b502f-6ccc-5483-9df0-0972dbb8f3d9
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd0264d0>
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0077dae7-9082-5831-b811-58838feecdff/0077dae7-9082-5831-b811-58838feecdff_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb2%252Ff9b21d4809200a6d8c70a57b5ebcce99%252Fpa%252FEY62872_981a51de3a84cb55a977e4b2a9526581.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_981a51de3a84cb55a977e4b2a9526581.jpg saved to cache
2026-03-28 12:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0077dae7-9082-5831-b811-58838feecdff
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc392310>
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a8b502f-6ccc-5483-9df0-0972dbb8f3d9/4a8b502f-6ccc-5483-9df0-0972dbb8f3d9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a05ec4e33e66f0cb5ad199c354bcfb%252Fpa%252FEU57494_369eeee529c3113e2241a600636654a5.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_369eeee529c3113e2241a600636654a5.jpg saved to cache
2026-03-28 12:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4a8b502f-6ccc-5483-9df0-0972dbb8f3d9
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc2745d0>
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0077dae7-9082-5831-b811-58838feecdff/0077dae7-9082-5831-b811-58838feecdff_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb2%252Ff9b21d4809200a6d8c70a57b5ebcce99%252Fpa%252FEY62872_e54acd6c631aa8c4e7fa91b6ff4b8d64.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_e54acd6c631aa8c4e7fa91b6ff4b8d64.jpg saved to cache
2026-03-28 12:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0077dae7-9082-5831-b811-58838feecdff
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf065d0>
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3225aaca-17bf-5e31-964b-d12a780c6b27/3225aaca-17bf-5e31-964b-d12a780c6b27_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fb3%252Fc1b317ca2fd375282532e65a5130627f%252Fpa%252FAL33204_5d2d94c402ded8cf0b528ee341a34414.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_5d2d94c402ded8cf0b528ee341a34414.jpg saved to cache
2026-03-28 12:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3225aaca-17bf-5e31-964b-d12a780c6b27
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bce7f650>
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0077dae7-9082-5831-b811-58838feecdff/0077dae7-9082-5831-b811-58838feecdff_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb2%252Ff9b21d4809200a6d8c70a57b5ebcce99%252Fpa%252FEY62872_7af143096ba37927c5f1a8521dfd1e96.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_7af143096ba37927c5f1a8521dfd1e96.jpg saved to cache
2026-03-28 12:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0077dae7-9082-5831-b811-58838feecdff
2026-03-28 12:06:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 200375bf-4134-55bb-af6f-34f20e37f617 with identifier: DU34377
2026-03-28 12:06:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 200375bf-4134-55bb-af6f-34f20e37f617 with scrape type 1
2026-03-28 12:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 200375bf-4134-55bb-af6f-34f20e37f617
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Faa%252F56aac87e4b30e025683a95487f93fe20%252Fpa%252FDU34377_66e7c3ee7ca01559925cda88270b4b35.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/aa/56aac87e4b30e025683a95487f93fe20/pa/DU34377_66e7c3ee7ca01559925cda88270b4b35.jpg not downloaded yet
2026-03-28 12:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_394f119855b3628de9eb326c083df8b1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_f842161d5daad8b64a0f51c5a98f686b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Faa%252F56aac87e4b30e025683a95487f93fe20%252Fpa%252FDU34377_46e215e7d4ccd509df1dc1649476dc9e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/aa/56aac87e4b30e025683a95487f93fe20/pa/DU34377_46e215e7d4ccd509df1dc1649476dc9e.jpg not downloaded yet
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Faa%252F56aac87e4b30e025683a95487f93fe20%252Fpa%252FDU34377_43a9a8551bb3d2357462dba8802a5a7b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/aa/56aac87e4b30e025683a95487f93fe20/pa/DU34377_43a9a8551bb3d2357462dba8802a5a7b.jpg not downloaded yet
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Faa%252F56aac87e4b30e025683a95487f93fe20%252Fpa%252FDU34377_f1423f4bd3dcdfa46646c985e5e4bf1a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/aa/56aac87e4b30e025683a95487f93fe20/pa/DU34377_f1423f4bd3dcdfa46646c985e5e4bf1a.jpg not downloaded yet
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Faa%252F56aac87e4b30e025683a95487f93fe20%252Fpa%252FDU34377_e92f11ddfd8ea6cb76cbaaea8a70203d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/aa/56aac87e4b30e025683a95487f93fe20/pa/DU34377_e92f11ddfd8ea6cb76cbaaea8a70203d.jpg not downloaded yet
2026-03-28 12:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd06ea50>
2026-03-28 12:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3225aaca-17bf-5e31-964b-d12a780c6b27/3225aaca-17bf-5e31-964b-d12a780c6b27_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fb3%252Fc1b317ca2fd375282532e65a5130627f%252Fpa%252FAL33204_394f119855b3628de9eb326c083df8b1.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_394f119855b3628de9eb326c083df8b1.jpg saved to cache
2026-03-28 12:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3225aaca-17bf-5e31-964b-d12a780c6b27
2026-03-28 12:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfc9910>
2026-03-28 12:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_125b1a7b-6637-556f-aa40-9f9e3f8626e4/125b1a7b-6637-556f-aa40-9f9e3f8626e4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F11%252F8a11d4af41574889790bbae295c62423%252Fpa%252FHC79760_f842161d5daad8b64a0f51c5a98f686b.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_f842161d5daad8b64a0f51c5a98f686b.jpg saved to cache
2026-03-28 12:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 125b1a7b-6637-556f-aa40-9f9e3f8626e4
2026-03-28 12:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_13e038536252e99723b7c61535d2e570.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_f17852d84a0775321cf96f8c656cfdb8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_25a9729cf8aee5c4c110a5e029e37ab7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_ca923b914fe41eb9ad4d77ffc9d348bf.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_9cae8c2fc0ff64d349499d3ee42f76ab.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_4e6f396cbd7ebdd1c1a9f7353c665f47.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_ab08134f2b1ad24a55edccde29cd640b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_a2b4044cd08eac16d2861f31b75db3b2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_7c68f6284b34de2d01bb07ddeaa67984.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/aa/56aac87e4b30e025683a95487f93fe20/pa/DU34377_66e7c3ee7ca01559925cda88270b4b35.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_6604ffcaef8f9cfdb00a66d462ca1173.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/c8/78c8994908530a10f2fa5ac5c83a0fc2/pa/UM38141_94d8d92ddde9d0c9fdf45c538eccc4af.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/aa/56aac87e4b30e025683a95487f93fe20/pa/DU34377_f1423f4bd3dcdfa46646c985e5e4bf1a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc548390>
2026-03-28 12:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0077dae7-9082-5831-b811-58838feecdff/0077dae7-9082-5831-b811-58838feecdff_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb2%252Ff9b21d4809200a6d8c70a57b5ebcce99%252Fpa%252FEY62872_13e038536252e99723b7c61535d2e570.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_13e038536252e99723b7c61535d2e570.jpg saved to cache
2026-03-28 12:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0077dae7-9082-5831-b811-58838feecdff
2026-03-28 12:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/aa/56aac87e4b30e025683a95487f93fe20/pa/DU34377_e92f11ddfd8ea6cb76cbaaea8a70203d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/aa/56aac87e4b30e025683a95487f93fe20/pa/DU34377_43a9a8551bb3d2357462dba8802a5a7b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_52ec737b42e3f2fd8426e1350c56bce7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc521d50>
2026-03-28 12:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0077dae7-9082-5831-b811-58838feecdff/0077dae7-9082-5831-b811-58838feecdff_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb2%252Ff9b21d4809200a6d8c70a57b5ebcce99%252Fpa%252FEY62872_f17852d84a0775321cf96f8c656cfdb8.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_f17852d84a0775321cf96f8c656cfdb8.jpg saved to cache
2026-03-28 12:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0077dae7-9082-5831-b811-58838feecdff
2026-03-28 12:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc521410>
2026-03-28 12:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3225aaca-17bf-5e31-964b-d12a780c6b27/3225aaca-17bf-5e31-964b-d12a780c6b27_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fb3%252Fc1b317ca2fd375282532e65a5130627f%252Fpa%252FAL33204_25a9729cf8aee5c4c110a5e029e37ab7.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_25a9729cf8aee5c4c110a5e029e37ab7.jpg saved to cache
2026-03-28 12:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3225aaca-17bf-5e31-964b-d12a780c6b27
2026-03-28 12:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc65af10>
2026-03-28 12:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_538ddd9a-147f-5bdf-b06d-ef0bff55e2ff/538ddd9a-147f-5bdf-b06d-ef0bff55e2ff_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F73%252Fad733e6d919519082d2bf7512bd62450%252Fpa%252FYD14292_ca923b914fe41eb9ad4d77ffc9d348bf.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_ca923b914fe41eb9ad4d77ffc9d348bf.jpg saved to cache
2026-03-28 12:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 538ddd9a-147f-5bdf-b06d-ef0bff55e2ff
2026-03-28 12:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc606ad0>
2026-03-28 12:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a8b502f-6ccc-5483-9df0-0972dbb8f3d9/4a8b502f-6ccc-5483-9df0-0972dbb8f3d9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a05ec4e33e66f0cb5ad199c354bcfb%252Fpa%252FEU57494_9cae8c2fc0ff64d349499d3ee42f76ab.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_9cae8c2fc0ff64d349499d3ee42f76ab.jpg saved to cache
2026-03-28 12:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4a8b502f-6ccc-5483-9df0-0972dbb8f3d9
2026-03-28 12:06:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4a8b502f-6ccc-5483-9df0-0972dbb8f3d9, skipping ID generation
2026-03-28 12:06:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a8b502f-6ccc-5483-9df0-0972dbb8f3d9 with scrape type 1
2026-03-28 12:06:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4a8b502f-6ccc-5483-9df0-0972dbb8f3d9 sending to next pipeline
2026-03-28 12:06:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4a8b502f-6ccc-5483-9df0-0972dbb8f3d9, identifier: EU57494
2026-03-28 12:06:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04beeef710>
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3225aaca-17bf-5e31-964b-d12a780c6b27/3225aaca-17bf-5e31-964b-d12a780c6b27_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fb3%252Fc1b317ca2fd375282532e65a5130627f%252Fpa%252FAL33204_4e6f396cbd7ebdd1c1a9f7353c665f47.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_4e6f396cbd7ebdd1c1a9f7353c665f47.jpg saved to cache
2026-03-28 12:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3225aaca-17bf-5e31-964b-d12a780c6b27
2026-03-28 12:06:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfdafd0>
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f35d65-c75a-544a-bcc6-29d77a5b267f/30f35d65-c75a-544a-bcc6-29d77a5b267f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F97%252Fa597a3d71076ca34f9a1fd745e8975d4%252Fpa%252FVU45167_ab08134f2b1ad24a55edccde29cd640b.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_ab08134f2b1ad24a55edccde29cd640b.jpg saved to cache
2026-03-28 12:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 30f35d65-c75a-544a-bcc6-29d77a5b267f
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd011a50>
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3225aaca-17bf-5e31-964b-d12a780c6b27/3225aaca-17bf-5e31-964b-d12a780c6b27_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fb3%252Fc1b317ca2fd375282532e65a5130627f%252Fpa%252FAL33204_a2b4044cd08eac16d2861f31b75db3b2.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_a2b4044cd08eac16d2861f31b75db3b2.jpg saved to cache
2026-03-28 12:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3225aaca-17bf-5e31-964b-d12a780c6b27
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc275650>
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f35d65-c75a-544a-bcc6-29d77a5b267f/30f35d65-c75a-544a-bcc6-29d77a5b267f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F97%252Fa597a3d71076ca34f9a1fd745e8975d4%252Fpa%252FVU45167_7c68f6284b34de2d01bb07ddeaa67984.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_7c68f6284b34de2d01bb07ddeaa67984.jpg saved to cache
2026-03-28 12:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 30f35d65-c75a-544a-bcc6-29d77a5b267f
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf34690>
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_200375bf-4134-55bb-af6f-34f20e37f617/200375bf-4134-55bb-af6f-34f20e37f617_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Faa%252F56aac87e4b30e025683a95487f93fe20%252Fpa%252FDU34377_66e7c3ee7ca01559925cda88270b4b35.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/aa/56aac87e4b30e025683a95487f93fe20/pa/DU34377_66e7c3ee7ca01559925cda88270b4b35.jpg saved to cache
2026-03-28 12:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 200375bf-4134-55bb-af6f-34f20e37f617
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5665d0>
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_538ddd9a-147f-5bdf-b06d-ef0bff55e2ff/538ddd9a-147f-5bdf-b06d-ef0bff55e2ff_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F73%252Fad733e6d919519082d2bf7512bd62450%252Fpa%252FYD14292_6604ffcaef8f9cfdb00a66d462ca1173.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_6604ffcaef8f9cfdb00a66d462ca1173.jpg saved to cache
2026-03-28 12:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 538ddd9a-147f-5bdf-b06d-ef0bff55e2ff
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5944d0>
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d30fe5e-01e6-5e04-a30f-72906e911127/4d30fe5e-01e6-5e04-a30f-72906e911127_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fc8%252F78c8994908530a10f2fa5ac5c83a0fc2%252Fpa%252FUM38141_94d8d92ddde9d0c9fdf45c538eccc4af.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/c8/78c8994908530a10f2fa5ac5c83a0fc2/pa/UM38141_94d8d92ddde9d0c9fdf45c538eccc4af.jpg saved to cache
2026-03-28 12:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4d30fe5e-01e6-5e04-a30f-72906e911127
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfb4450>
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_200375bf-4134-55bb-af6f-34f20e37f617/200375bf-4134-55bb-af6f-34f20e37f617_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Faa%252F56aac87e4b30e025683a95487f93fe20%252Fpa%252FDU34377_f1423f4bd3dcdfa46646c985e5e4bf1a.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/aa/56aac87e4b30e025683a95487f93fe20/pa/DU34377_f1423f4bd3dcdfa46646c985e5e4bf1a.jpg saved to cache
2026-03-28 12:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 200375bf-4134-55bb-af6f-34f20e37f617
2026-03-28 12:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_45e422a6678fe70460a3868b60e7abed.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4a8b502f-6ccc-5483-9df0-0972dbb8f3d9 with identifier: EU57494
2026-03-28 12:06:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4a8b502f-6ccc-5483-9df0-0972dbb8f3d9 with identifier: EU57494
2026-03-28 12:06:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4a8b502f-6ccc-5483-9df0-0972dbb8f3d9 with identifier: EU57494 to the API
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_9cae8c2fc0ff64d349499d3ee42f76ab.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:20:05Z',
 'fuel_type': 'hybrid',
 'id': '4a8b502f-6ccc-5483-9df0-0972dbb8f3d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU57494',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Toyota',
 'model': 'Yaris Cross',
 'odometer': 8019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a8b502f-6ccc-5483-9df0-0972dbb8f3d9/4a8b502f-6ccc-5483-9df0-0972dbb8f3d9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2555765,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_9cae8c2fc0ff64d349499d3ee42f76ab.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a8b502f-6ccc-5483-9df0-0972dbb8f3d9/4a8b502f-6ccc-5483-9df0-0972dbb8f3d9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_369eeee529c3113e2241a600636654a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a8b502f-6ccc-5483-9df0-0972dbb8f3d9/4a8b502f-6ccc-5483-9df0-0972dbb8f3d9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_2413aea49adc4fde8c2abdd1953af3bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a8b502f-6ccc-5483-9df0-0972dbb8f3d9/4a8b502f-6ccc-5483-9df0-0972dbb8f3d9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_99e058d6e1aee03a08ddc9a9552a3950.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a8b502f-6ccc-5483-9df0-0972dbb8f3d9/4a8b502f-6ccc-5483-9df0-0972dbb8f3d9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69976,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_413bbc5e9cb1807992298c3408518fb2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a8b502f-6ccc-5483-9df0-0972dbb8f3d9/4a8b502f-6ccc-5483-9df0-0972dbb8f3d9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77765,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_f3cab75a00241c63563178ebb897d454.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a8b502f-6ccc-5483-9df0-0972dbb8f3d9/4a8b502f-6ccc-5483-9df0-0972dbb8f3d9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68779,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_9539c40da686f649d76f201bebc93d1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a8b502f-6ccc-5483-9df0-0972dbb8f3d9/4a8b502f-6ccc-5483-9df0-0972dbb8f3d9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_2f0728264b718f93083788e1fd006980.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a8b502f-6ccc-5483-9df0-0972dbb8f3d9/4a8b502f-6ccc-5483-9df0-0972dbb8f3d9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_a329b58b1bc37b34ce678284f896244e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a8b502f-6ccc-5483-9df0-0972dbb8f3d9/4a8b502f-6ccc-5483-9df0-0972dbb8f3d9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/a0/28a05ec4e33e66f0cb5ad199c354bcfb/pa/EU57494_c7d1a1267dc7bf36f858c57ad104b0f9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris Cross 1.5 Hybrid 2WD Lounge',
 'transmission': 'automatic',
 'trim': '2WD Lounge',
 'year': 2022}
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU57494%27 HTTP/1.1" 200 None
2026-03-28 12:06:29 [auto1.it] INFO: Saving data for EU57494: {'created_time': 1774699589.88535, 'last_price_update_time': 1774699589.885358, 'auction_closing_time': 1774884005.0}
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EU57494') HTTP/1.1" 204 0
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3c4dd0>
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_200375bf-4134-55bb-af6f-34f20e37f617/200375bf-4134-55bb-af6f-34f20e37f617_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Faa%252F56aac87e4b30e025683a95487f93fe20%252Fpa%252FDU34377_e92f11ddfd8ea6cb76cbaaea8a70203d.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/aa/56aac87e4b30e025683a95487f93fe20/pa/DU34377_e92f11ddfd8ea6cb76cbaaea8a70203d.jpg saved to cache
2026-03-28 12:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 200375bf-4134-55bb-af6f-34f20e37f617
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3c78d0>
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_200375bf-4134-55bb-af6f-34f20e37f617/200375bf-4134-55bb-af6f-34f20e37f617_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Faa%252F56aac87e4b30e025683a95487f93fe20%252Fpa%252FDU34377_43a9a8551bb3d2357462dba8802a5a7b.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/aa/56aac87e4b30e025683a95487f93fe20/pa/DU34377_43a9a8551bb3d2357462dba8802a5a7b.jpg saved to cache
2026-03-28 12:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 200375bf-4134-55bb-af6f-34f20e37f617
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bceb4d10>
2026-03-28 12:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f35d65-c75a-544a-bcc6-29d77a5b267f/30f35d65-c75a-544a-bcc6-29d77a5b267f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F97%252Fa597a3d71076ca34f9a1fd745e8975d4%252Fpa%252FVU45167_52ec737b42e3f2fd8426e1350c56bce7.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_52ec737b42e3f2fd8426e1350c56bce7.jpg saved to cache
2026-03-28 12:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 30f35d65-c75a-544a-bcc6-29d77a5b267f
2026-03-28 12:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc561410>
2026-03-28 12:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0077dae7-9082-5831-b811-58838feecdff/0077dae7-9082-5831-b811-58838feecdff_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb2%252Ff9b21d4809200a6d8c70a57b5ebcce99%252Fpa%252FEY62872_45e422a6678fe70460a3868b60e7abed.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_45e422a6678fe70460a3868b60e7abed.jpg saved to cache
2026-03-28 12:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0077dae7-9082-5831-b811-58838feecdff
2026-03-28 12:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_66231fc5800739c9d50fdecdd74645d4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_1c7dd74b754e4a1c4d61eb92be9a1674.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_1e807387effad6d08290427669720f92.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/aa/56aac87e4b30e025683a95487f93fe20/pa/DU34377_46e215e7d4ccd509df1dc1649476dc9e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/c8/78c8994908530a10f2fa5ac5c83a0fc2/pa/UM38141_d6a16e8e5630e20c80cdf58b8f544eda.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_05c1cfebab3be390ab6d8f4012e481c4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc562790>
2026-03-28 12:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4e4cb87-df47-57e4-b8ad-6419a1fd3c07/b4e4cb87-df47-57e4-b8ad-6419a1fd3c07_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F62%252Fdb62b21d8b75e15ca8777883db174739%252Fpa%252FVJ26511_66231fc5800739c9d50fdecdd74645d4.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_66231fc5800739c9d50fdecdd74645d4.jpg saved to cache
2026-03-28 12:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b4e4cb87-df47-57e4-b8ad-6419a1fd3c07
2026-03-28 12:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_fffafc374460344fb5963c64f0d6d226.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5a9310>
2026-03-28 12:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_125b1a7b-6637-556f-aa40-9f9e3f8626e4/125b1a7b-6637-556f-aa40-9f9e3f8626e4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F11%252F8a11d4af41574889790bbae295c62423%252Fpa%252FHC79760_1c7dd74b754e4a1c4d61eb92be9a1674.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_1c7dd74b754e4a1c4d61eb92be9a1674.jpg saved to cache
2026-03-28 12:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 125b1a7b-6637-556f-aa40-9f9e3f8626e4
2026-03-28 12:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_219eed5c454f4dc5381eda12a545db59.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc54db90>
2026-03-28 12:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_125b1a7b-6637-556f-aa40-9f9e3f8626e4/125b1a7b-6637-556f-aa40-9f9e3f8626e4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F11%252F8a11d4af41574889790bbae295c62423%252Fpa%252FHC79760_1e807387effad6d08290427669720f92.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_1e807387effad6d08290427669720f92.jpg saved to cache
2026-03-28 12:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 125b1a7b-6637-556f-aa40-9f9e3f8626e4
2026-03-28 12:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd0fc490>
2026-03-28 12:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_200375bf-4134-55bb-af6f-34f20e37f617/200375bf-4134-55bb-af6f-34f20e37f617_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Faa%252F56aac87e4b30e025683a95487f93fe20%252Fpa%252FDU34377_46e215e7d4ccd509df1dc1649476dc9e.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/aa/56aac87e4b30e025683a95487f93fe20/pa/DU34377_46e215e7d4ccd509df1dc1649476dc9e.jpg saved to cache
2026-03-28 12:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 200375bf-4134-55bb-af6f-34f20e37f617
2026-03-28 12:06:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 200375bf-4134-55bb-af6f-34f20e37f617, skipping ID generation
2026-03-28 12:06:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 200375bf-4134-55bb-af6f-34f20e37f617 with scrape type 1
2026-03-28 12:06:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 200375bf-4134-55bb-af6f-34f20e37f617 sending to next pipeline
2026-03-28 12:06:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 200375bf-4134-55bb-af6f-34f20e37f617, identifier: DU34377
2026-03-28 12:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc4f4890>
2026-03-28 12:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d30fe5e-01e6-5e04-a30f-72906e911127/4d30fe5e-01e6-5e04-a30f-72906e911127_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fc8%252F78c8994908530a10f2fa5ac5c83a0fc2%252Fpa%252FUM38141_d6a16e8e5630e20c80cdf58b8f544eda.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/c8/78c8994908530a10f2fa5ac5c83a0fc2/pa/UM38141_d6a16e8e5630e20c80cdf58b8f544eda.jpg saved to cache
2026-03-28 12:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4d30fe5e-01e6-5e04-a30f-72906e911127
2026-03-28 12:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5cad90>
2026-03-28 12:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3225aaca-17bf-5e31-964b-d12a780c6b27/3225aaca-17bf-5e31-964b-d12a780c6b27_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fb3%252Fc1b317ca2fd375282532e65a5130627f%252Fpa%252FAL33204_05c1cfebab3be390ab6d8f4012e481c4.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_05c1cfebab3be390ab6d8f4012e481c4.jpg saved to cache
2026-03-28 12:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3225aaca-17bf-5e31-964b-d12a780c6b27
2026-03-28 12:06:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 200375bf-4134-55bb-af6f-34f20e37f617 with identifier: DU34377
2026-03-28 12:06:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 200375bf-4134-55bb-af6f-34f20e37f617 with identifier: DU34377
2026-03-28 12:06:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 200375bf-4134-55bb-af6f-34f20e37f617 with identifier: DU34377 to the API
2026-03-28 12:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img56/aa/56aac87e4b30e025683a95487f93fe20/pa/DU34377_46e215e7d4ccd509df1dc1649476dc9e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.5L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:14:28Z',
 'fuel_type': 'diesel',
 'id': '200375bf-4134-55bb-af6f-34f20e37f617',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU34377',
 'listing': 'auction',
 'location': 'IT, Napoli',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 223232,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_200375bf-4134-55bb-af6f-34f20e37f617/200375bf-4134-55bb-af6f-34f20e37f617_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/aa/56aac87e4b30e025683a95487f93fe20/pa/DU34377_66e7c3ee7ca01559925cda88270b4b35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_200375bf-4134-55bb-af6f-34f20e37f617/200375bf-4134-55bb-af6f-34f20e37f617_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74685,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/aa/56aac87e4b30e025683a95487f93fe20/pa/DU34377_46e215e7d4ccd509df1dc1649476dc9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_200375bf-4134-55bb-af6f-34f20e37f617/200375bf-4134-55bb-af6f-34f20e37f617_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78014,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/aa/56aac87e4b30e025683a95487f93fe20/pa/DU34377_43a9a8551bb3d2357462dba8802a5a7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_200375bf-4134-55bb-af6f-34f20e37f617/200375bf-4134-55bb-af6f-34f20e37f617_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/aa/56aac87e4b30e025683a95487f93fe20/pa/DU34377_f1423f4bd3dcdfa46646c985e5e4bf1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_200375bf-4134-55bb-af6f-34f20e37f617/200375bf-4134-55bb-af6f-34f20e37f617_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/aa/56aac87e4b30e025683a95487f93fe20/pa/DU34377_e92f11ddfd8ea6cb76cbaaea8a70203d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-12-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 dCi Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2007}
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU34377%27 HTTP/1.1" 200 None
2026-03-28 12:06:31 [auto1.it] INFO: Saving data for DU34377: {'created_time': 1774699591.411869, 'last_price_update_time': 1774699591.41188, 'auction_closing_time': 1774883668.0}
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DU34377') HTTP/1.1" 204 0
2026-03-28 12:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_0b2a0b76afbcab350ac5e1efb14c5eca.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/ab/41abba4c065e15e533dd8e7a58ac874a/pa/SZ93699_93a508b4866bac850f6245b2b532b402.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bf1ace50>
2026-03-28 12:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f35d65-c75a-544a-bcc6-29d77a5b267f/30f35d65-c75a-544a-bcc6-29d77a5b267f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F97%252Fa597a3d71076ca34f9a1fd745e8975d4%252Fpa%252FVU45167_fffafc374460344fb5963c64f0d6d226.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_fffafc374460344fb5963c64f0d6d226.jpg saved to cache
2026-03-28 12:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 30f35d65-c75a-544a-bcc6-29d77a5b267f
2026-03-28 12:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bf286890>
2026-03-28 12:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4e4cb87-df47-57e4-b8ad-6419a1fd3c07/b4e4cb87-df47-57e4-b8ad-6419a1fd3c07_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F62%252Fdb62b21d8b75e15ca8777883db174739%252Fpa%252FVJ26511_219eed5c454f4dc5381eda12a545db59.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_219eed5c454f4dc5381eda12a545db59.jpg saved to cache
2026-03-28 12:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b4e4cb87-df47-57e4-b8ad-6419a1fd3c07
2026-03-28 12:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_78e2db57de42b566b5cfccb8715ec6df.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_2640c9edecdf68081b30239e7dbd92f1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_d35fc242d157e4a6311cd2d311d50976.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_23bbc4e13a7b0e3ce245715f5b62bb49.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_0955b55d7431518482381adabff3285c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc573a90>
2026-03-28 12:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3225aaca-17bf-5e31-964b-d12a780c6b27/3225aaca-17bf-5e31-964b-d12a780c6b27_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fb3%252Fc1b317ca2fd375282532e65a5130627f%252Fpa%252FAL33204_0b2a0b76afbcab350ac5e1efb14c5eca.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_0b2a0b76afbcab350ac5e1efb14c5eca.jpg saved to cache
2026-03-28 12:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3225aaca-17bf-5e31-964b-d12a780c6b27
2026-03-28 12:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3f2790>
2026-03-28 12:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d7fc43-fb9d-5932-a17a-a2dbfd8793c0/73d7fc43-fb9d-5932-a17a-a2dbfd8793c0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fab%252F41abba4c065e15e533dd8e7a58ac874a%252Fpa%252FSZ93699_93a508b4866bac850f6245b2b532b402.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/ab/41abba4c065e15e533dd8e7a58ac874a/pa/SZ93699_93a508b4866bac850f6245b2b532b402.jpg saved to cache
2026-03-28 12:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 73d7fc43-fb9d-5932-a17a-a2dbfd8793c0
2026-03-28 12:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_00ecc9de77dee3994b1623679e73adc3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/ab/41abba4c065e15e533dd8e7a58ac874a/pa/SZ93699_7bde064678541e03b1f22254a1894c73.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_2a7696a63446033ee12270a46e54cf7c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/c8/78c8994908530a10f2fa5ac5c83a0fc2/pa/UM38141_0e5bb578f72cf5ad43f009a1cdeea1eb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04beed9390>
2026-03-28 12:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_538ddd9a-147f-5bdf-b06d-ef0bff55e2ff/538ddd9a-147f-5bdf-b06d-ef0bff55e2ff_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F73%252Fad733e6d919519082d2bf7512bd62450%252Fpa%252FYD14292_78e2db57de42b566b5cfccb8715ec6df.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_78e2db57de42b566b5cfccb8715ec6df.jpg saved to cache
2026-03-28 12:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 538ddd9a-147f-5bdf-b06d-ef0bff55e2ff
2026-03-28 12:06:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 538ddd9a-147f-5bdf-b06d-ef0bff55e2ff, skipping ID generation
2026-03-28 12:06:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 538ddd9a-147f-5bdf-b06d-ef0bff55e2ff with scrape type 1
2026-03-28 12:06:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 538ddd9a-147f-5bdf-b06d-ef0bff55e2ff sending to next pipeline
2026-03-28 12:06:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 538ddd9a-147f-5bdf-b06d-ef0bff55e2ff, identifier: YD14292
2026-03-28 12:06:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 538ddd9a-147f-5bdf-b06d-ef0bff55e2ff with identifier: YD14292
2026-03-28 12:06:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 538ddd9a-147f-5bdf-b06d-ef0bff55e2ff with identifier: YD14292
2026-03-28 12:06:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 538ddd9a-147f-5bdf-b06d-ef0bff55e2ff with identifier: YD14292 to the API
2026-03-28 12:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_78e2db57de42b566b5cfccb8715ec6df.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 188,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:14:23Z',
 'fuel_type': 'petrol',
 'id': '538ddd9a-147f-5bdf-b06d-ef0bff55e2ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD14292',
 'listing': 'auction',
 'location': 'IT, Como',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 131881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_538ddd9a-147f-5bdf-b06d-ef0bff55e2ff/538ddd9a-147f-5bdf-b06d-ef0bff55e2ff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2058100,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_78e2db57de42b566b5cfccb8715ec6df.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_538ddd9a-147f-5bdf-b06d-ef0bff55e2ff/538ddd9a-147f-5bdf-b06d-ef0bff55e2ff_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61587,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_6604ffcaef8f9cfdb00a66d462ca1173.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_538ddd9a-147f-5bdf-b06d-ef0bff55e2ff/538ddd9a-147f-5bdf-b06d-ef0bff55e2ff_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1942356,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_171caf71bd4488f1bc723ecc8e5da891.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_538ddd9a-147f-5bdf-b06d-ef0bff55e2ff/538ddd9a-147f-5bdf-b06d-ef0bff55e2ff_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1855686,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_d3f5bcd4801a25daa14581aa85e95a53.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_538ddd9a-147f-5bdf-b06d-ef0bff55e2ff/538ddd9a-147f-5bdf-b06d-ef0bff55e2ff_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1898294,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_ca923b914fe41eb9ad4d77ffc9d348bf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_538ddd9a-147f-5bdf-b06d-ef0bff55e2ff/538ddd9a-147f-5bdf-b06d-ef0bff55e2ff_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_3efc7a4f8f3ffd7575f95d00bc0bd06d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_538ddd9a-147f-5bdf-b06d-ef0bff55e2ff/538ddd9a-147f-5bdf-b06d-ef0bff55e2ff_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_d85249778ded3cd650f1f35ca79b5136.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_538ddd9a-147f-5bdf-b06d-ef0bff55e2ff/538ddd9a-147f-5bdf-b06d-ef0bff55e2ff_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_e6efcccd127c5ffe06e4ece03890dc6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_538ddd9a-147f-5bdf-b06d-ef0bff55e2ff/538ddd9a-147f-5bdf-b06d-ef0bff55e2ff_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_d134bfd7eb19486222228363d8bfb8d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_538ddd9a-147f-5bdf-b06d-ef0bff55e2ff/538ddd9a-147f-5bdf-b06d-ef0bff55e2ff_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38924,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/73/ad733e6d919519082d2bf7512bd62450/pa/YD14292_a7343bf1e1a978d3bcee49935b798044.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-07-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 2.0 TFSI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2011}
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD14292%27 HTTP/1.1" 200 None
2026-03-28 12:06:32 [auto1.it] INFO: Saving data for YD14292: {'created_time': 1774699592.191417, 'last_price_update_time': 1774699592.191427, 'auction_closing_time': 1774883663.0}
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YD14292') HTTP/1.1" 204 0
2026-03-28 12:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_a75d50a595c8a8eab40b0387d88d9b95.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_4a06f37229ba05e807f72b59b6f8c6c9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_2627b4766b6e5c41d40ea028818fa5ff.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf3d390>
2026-03-28 12:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0077dae7-9082-5831-b811-58838feecdff/0077dae7-9082-5831-b811-58838feecdff_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb2%252Ff9b21d4809200a6d8c70a57b5ebcce99%252Fpa%252FEY62872_2640c9edecdf68081b30239e7dbd92f1.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_2640c9edecdf68081b30239e7dbd92f1.jpg saved to cache
2026-03-28 12:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0077dae7-9082-5831-b811-58838feecdff
2026-03-28 12:06:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0077dae7-9082-5831-b811-58838feecdff, skipping ID generation
2026-03-28 12:06:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0077dae7-9082-5831-b811-58838feecdff with scrape type 1
2026-03-28 12:06:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0077dae7-9082-5831-b811-58838feecdff sending to next pipeline
2026-03-28 12:06:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0077dae7-9082-5831-b811-58838feecdff, identifier: EY62872
2026-03-28 12:06:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bf1c3650>
2026-03-28 12:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4e4cb87-df47-57e4-b8ad-6419a1fd3c07/b4e4cb87-df47-57e4-b8ad-6419a1fd3c07_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F62%252Fdb62b21d8b75e15ca8777883db174739%252Fpa%252FVJ26511_d35fc242d157e4a6311cd2d311d50976.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_d35fc242d157e4a6311cd2d311d50976.jpg saved to cache
2026-03-28 12:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b4e4cb87-df47-57e4-b8ad-6419a1fd3c07
2026-03-28 12:06:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf78090>
2026-03-28 12:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3225aaca-17bf-5e31-964b-d12a780c6b27/3225aaca-17bf-5e31-964b-d12a780c6b27_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fb3%252Fc1b317ca2fd375282532e65a5130627f%252Fpa%252FAL33204_23bbc4e13a7b0e3ce245715f5b62bb49.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_23bbc4e13a7b0e3ce245715f5b62bb49.jpg saved to cache
2026-03-28 12:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3225aaca-17bf-5e31-964b-d12a780c6b27
2026-03-28 12:06:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfae1d0>
2026-03-28 12:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f35d65-c75a-544a-bcc6-29d77a5b267f/30f35d65-c75a-544a-bcc6-29d77a5b267f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F97%252Fa597a3d71076ca34f9a1fd745e8975d4%252Fpa%252FVU45167_0955b55d7431518482381adabff3285c.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_0955b55d7431518482381adabff3285c.jpg saved to cache
2026-03-28 12:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 30f35d65-c75a-544a-bcc6-29d77a5b267f
2026-03-28 12:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc672a10>
2026-03-28 12:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_125b1a7b-6637-556f-aa40-9f9e3f8626e4/125b1a7b-6637-556f-aa40-9f9e3f8626e4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F11%252F8a11d4af41574889790bbae295c62423%252Fpa%252FHC79760_00ecc9de77dee3994b1623679e73adc3.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_00ecc9de77dee3994b1623679e73adc3.jpg saved to cache
2026-03-28 12:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 125b1a7b-6637-556f-aa40-9f9e3f8626e4
2026-03-28 12:06:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 125b1a7b-6637-556f-aa40-9f9e3f8626e4, skipping ID generation
2026-03-28 12:06:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 125b1a7b-6637-556f-aa40-9f9e3f8626e4 with scrape type 1
2026-03-28 12:06:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 125b1a7b-6637-556f-aa40-9f9e3f8626e4 sending to next pipeline
2026-03-28 12:06:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 125b1a7b-6637-556f-aa40-9f9e3f8626e4, identifier: HC79760
2026-03-28 12:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5fdd10>
2026-03-28 12:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d7fc43-fb9d-5932-a17a-a2dbfd8793c0/73d7fc43-fb9d-5932-a17a-a2dbfd8793c0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fab%252F41abba4c065e15e533dd8e7a58ac874a%252Fpa%252FSZ93699_7bde064678541e03b1f22254a1894c73.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/ab/41abba4c065e15e533dd8e7a58ac874a/pa/SZ93699_7bde064678541e03b1f22254a1894c73.jpg saved to cache
2026-03-28 12:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 73d7fc43-fb9d-5932-a17a-a2dbfd8793c0
2026-03-28 12:06:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc572f50>
2026-03-28 12:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4e4cb87-df47-57e4-b8ad-6419a1fd3c07/b4e4cb87-df47-57e4-b8ad-6419a1fd3c07_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F62%252Fdb62b21d8b75e15ca8777883db174739%252Fpa%252FVJ26511_2a7696a63446033ee12270a46e54cf7c.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_2a7696a63446033ee12270a46e54cf7c.jpg saved to cache
2026-03-28 12:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b4e4cb87-df47-57e4-b8ad-6419a1fd3c07
2026-03-28 12:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfad190>
2026-03-28 12:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d30fe5e-01e6-5e04-a30f-72906e911127/4d30fe5e-01e6-5e04-a30f-72906e911127_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fc8%252F78c8994908530a10f2fa5ac5c83a0fc2%252Fpa%252FUM38141_0e5bb578f72cf5ad43f009a1cdeea1eb.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/c8/78c8994908530a10f2fa5ac5c83a0fc2/pa/UM38141_0e5bb578f72cf5ad43f009a1cdeea1eb.jpg saved to cache
2026-03-28 12:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4d30fe5e-01e6-5e04-a30f-72906e911127
2026-03-28 12:06:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4d30fe5e-01e6-5e04-a30f-72906e911127, skipping ID generation
2026-03-28 12:06:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d30fe5e-01e6-5e04-a30f-72906e911127 with scrape type 1
2026-03-28 12:06:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4d30fe5e-01e6-5e04-a30f-72906e911127 sending to next pipeline
2026-03-28 12:06:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4d30fe5e-01e6-5e04-a30f-72906e911127, identifier: UM38141
2026-03-28 12:06:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0077dae7-9082-5831-b811-58838feecdff with identifier: EY62872
2026-03-28 12:06:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0077dae7-9082-5831-b811-58838feecdff with identifier: EY62872
2026-03-28 12:06:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0077dae7-9082-5831-b811-58838feecdff with identifier: EY62872 to the API
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_2640c9edecdf68081b30239e7dbd92f1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:23:00Z',
 'fuel_type': 'diesel',
 'id': '0077dae7-9082-5831-b811-58838feecdff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY62872',
 'listing': 'auction',
 'location': 'IT, Roma RM',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 135743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0077dae7-9082-5831-b811-58838feecdff/0077dae7-9082-5831-b811-58838feecdff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2140249,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_2640c9edecdf68081b30239e7dbd92f1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0077dae7-9082-5831-b811-58838feecdff/0077dae7-9082-5831-b811-58838feecdff_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_45e422a6678fe70460a3868b60e7abed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0077dae7-9082-5831-b811-58838feecdff/0077dae7-9082-5831-b811-58838feecdff_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_2e9e02210952dfc44fecfe2fe7c1d8b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0077dae7-9082-5831-b811-58838feecdff/0077dae7-9082-5831-b811-58838feecdff_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1857070,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_e8cfd6c7a4fd92553fdcfef40c1c41af.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0077dae7-9082-5831-b811-58838feecdff/0077dae7-9082-5831-b811-58838feecdff_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51649,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_7af143096ba37927c5f1a8521dfd1e96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0077dae7-9082-5831-b811-58838feecdff/0077dae7-9082-5831-b811-58838feecdff_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_e54acd6c631aa8c4e7fa91b6ff4b8d64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0077dae7-9082-5831-b811-58838feecdff/0077dae7-9082-5831-b811-58838feecdff_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1896621,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_f17852d84a0775321cf96f8c656cfdb8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0077dae7-9082-5831-b811-58838feecdff/0077dae7-9082-5831-b811-58838feecdff_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_acaf2002b67bfc37c15cc3e87c9c86a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0077dae7-9082-5831-b811-58838feecdff/0077dae7-9082-5831-b811-58838feecdff_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_981a51de3a84cb55a977e4b2a9526581.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0077dae7-9082-5831-b811-58838feecdff/0077dae7-9082-5831-b811-58838feecdff_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2074676,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/b2/f9b21d4809200a6d8c70a57b5ebcce99/pa/EY62872_13e038536252e99723b7c61535d2e570.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2017}
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY62872%27 HTTP/1.1" 200 None
2026-03-28 12:06:33 [auto1.it] INFO: Saving data for EY62872: {'created_time': 1774699593.538643, 'last_price_update_time': 1774699593.538653, 'auction_closing_time': 1774884180.0}
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EY62872') HTTP/1.1" 204 0
2026-03-28 12:06:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 125b1a7b-6637-556f-aa40-9f9e3f8626e4 with identifier: HC79760
2026-03-28 12:06:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 125b1a7b-6637-556f-aa40-9f9e3f8626e4 with identifier: HC79760
2026-03-28 12:06:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 125b1a7b-6637-556f-aa40-9f9e3f8626e4 with identifier: HC79760 to the API
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_00ecc9de77dee3994b1623679e73adc3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:10:18Z',
 'fuel_type': 'diesel',
 'id': '125b1a7b-6637-556f-aa40-9f9e3f8626e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC79760',
 'listing': 'auction',
 'location': 'IT, Pavia',
 'make': 'BMW',
 'model': '5er',
 'odometer': 121314,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_125b1a7b-6637-556f-aa40-9f9e3f8626e4/125b1a7b-6637-556f-aa40-9f9e3f8626e4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_00ecc9de77dee3994b1623679e73adc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_125b1a7b-6637-556f-aa40-9f9e3f8626e4/125b1a7b-6637-556f-aa40-9f9e3f8626e4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63991,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_982ed81c120a1df7da41a5714e377516.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_125b1a7b-6637-556f-aa40-9f9e3f8626e4/125b1a7b-6637-556f-aa40-9f9e3f8626e4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_fc1d565be24e2db7f3be708dbab3807c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_125b1a7b-6637-556f-aa40-9f9e3f8626e4/125b1a7b-6637-556f-aa40-9f9e3f8626e4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_1e807387effad6d08290427669720f92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_125b1a7b-6637-556f-aa40-9f9e3f8626e4/125b1a7b-6637-556f-aa40-9f9e3f8626e4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2294989,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_1c7dd74b754e4a1c4d61eb92be9a1674.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_125b1a7b-6637-556f-aa40-9f9e3f8626e4/125b1a7b-6637-556f-aa40-9f9e3f8626e4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56408,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_fdd50fe3b7e99c82ad8e1274cac84fbc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_125b1a7b-6637-556f-aa40-9f9e3f8626e4/125b1a7b-6637-556f-aa40-9f9e3f8626e4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_f842161d5daad8b64a0f51c5a98f686b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_125b1a7b-6637-556f-aa40-9f9e3f8626e4/125b1a7b-6637-556f-aa40-9f9e3f8626e4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56508,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_624d04f589879d06c26d50edb183f035.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_125b1a7b-6637-556f-aa40-9f9e3f8626e4/125b1a7b-6637-556f-aa40-9f9e3f8626e4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_1135effdacbcc1807d45de740a962a18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_125b1a7b-6637-556f-aa40-9f9e3f8626e4/125b1a7b-6637-556f-aa40-9f9e3f8626e4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/11/8a11d4af41574889790bbae295c62423/pa/HC79760_b9e340f7a28420a51df7733db063893f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-05-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 530d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC79760%27 HTTP/1.1" 200 None
2026-03-28 12:06:33 [auto1.it] INFO: Saving data for HC79760: {'created_time': 1774699593.909936, 'last_price_update_time': 1774699593.909947, 'auction_closing_time': 1774883418.0}
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HC79760') HTTP/1.1" 204 0
2026-03-28 12:06:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4d30fe5e-01e6-5e04-a30f-72906e911127 with identifier: UM38141
2026-03-28 12:06:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4d30fe5e-01e6-5e04-a30f-72906e911127 with identifier: UM38141
2026-03-28 12:06:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4d30fe5e-01e6-5e04-a30f-72906e911127 with identifier: UM38141 to the API
2026-03-28 12:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img78/c8/78c8994908530a10f2fa5ac5c83a0fc2/pa/UM38141_0e5bb578f72cf5ad43f009a1cdeea1eb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:26:40Z',
 'fuel_type': 'gas',
 'id': '4d30fe5e-01e6-5e04-a30f-72906e911127',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM38141',
 'listing': 'auction',
 'location': 'IT, Camerano (AN)',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 344623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d30fe5e-01e6-5e04-a30f-72906e911127/4d30fe5e-01e6-5e04-a30f-72906e911127_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105546,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/c8/78c8994908530a10f2fa5ac5c83a0fc2/pa/UM38141_0e5bb578f72cf5ad43f009a1cdeea1eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d30fe5e-01e6-5e04-a30f-72906e911127/4d30fe5e-01e6-5e04-a30f-72906e911127_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/c8/78c8994908530a10f2fa5ac5c83a0fc2/pa/UM38141_2270882512715e147130c2461a424fef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d30fe5e-01e6-5e04-a30f-72906e911127/4d30fe5e-01e6-5e04-a30f-72906e911127_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/c8/78c8994908530a10f2fa5ac5c83a0fc2/pa/UM38141_ff7ca03828c54f3b559801f03dfcaaec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d30fe5e-01e6-5e04-a30f-72906e911127/4d30fe5e-01e6-5e04-a30f-72906e911127_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/c8/78c8994908530a10f2fa5ac5c83a0fc2/pa/UM38141_d6a16e8e5630e20c80cdf58b8f544eda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d30fe5e-01e6-5e04-a30f-72906e911127/4d30fe5e-01e6-5e04-a30f-72906e911127_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/c8/78c8994908530a10f2fa5ac5c83a0fc2/pa/UM38141_94d8d92ddde9d0c9fdf45c538eccc4af.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-09-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 BIFuel Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-28 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM38141%27 HTTP/1.1" 200 None
2026-03-28 12:06:34 [auto1.it] INFO: Saving data for UM38141: {'created_time': 1774699594.280045, 'last_price_update_time': 1774699594.280067, 'auction_closing_time': 1774884400.0}
2026-03-28 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UM38141') HTTP/1.1" 204 0
2026-03-28 12:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcefcc10>
2026-03-28 12:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99331b19-07da-57c2-8f19-2bf79e0ae01c/99331b19-07da-57c2-8f19-2bf79e0ae01c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fda%252F51dac849c5c7fed6fd1d19543af9859a%252Fpa%252FLC50167_a75d50a595c8a8eab40b0387d88d9b95.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_a75d50a595c8a8eab40b0387d88d9b95.jpg saved to cache
2026-03-28 12:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 99331b19-07da-57c2-8f19-2bf79e0ae01c
2026-03-28 12:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3abbd0>
2026-03-28 12:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f35d65-c75a-544a-bcc6-29d77a5b267f/30f35d65-c75a-544a-bcc6-29d77a5b267f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F97%252Fa597a3d71076ca34f9a1fd745e8975d4%252Fpa%252FVU45167_4a06f37229ba05e807f72b59b6f8c6c9.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_4a06f37229ba05e807f72b59b6f8c6c9.jpg saved to cache
2026-03-28 12:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 30f35d65-c75a-544a-bcc6-29d77a5b267f
2026-03-28 12:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd050290>
2026-03-28 12:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4e4cb87-df47-57e4-b8ad-6419a1fd3c07/b4e4cb87-df47-57e4-b8ad-6419a1fd3c07_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F62%252Fdb62b21d8b75e15ca8777883db174739%252Fpa%252FVJ26511_2627b4766b6e5c41d40ea028818fa5ff.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_2627b4766b6e5c41d40ea028818fa5ff.jpg saved to cache
2026-03-28 12:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b4e4cb87-df47-57e4-b8ad-6419a1fd3c07
2026-03-28 12:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/ab/41abba4c065e15e533dd8e7a58ac874a/pa/SZ93699_9b0bb27e165c2390330216f1ad248c86.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_ec892f3db86504e522ec0947de3fb133.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_fa16b73f10e6c4214f610e35fdbdf039.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_6f121af97fde8a18970ab86342438c7e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_eb5149cb1f514b632df2e9b35e76103c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_dddd342de4b7f4453f32bdbba660e4d5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_319b26c10013ccdfad341e94f0abc7c7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_ba1c811c4371789c43bde90f65473d23.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfb0c50>
2026-03-28 12:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d7fc43-fb9d-5932-a17a-a2dbfd8793c0/73d7fc43-fb9d-5932-a17a-a2dbfd8793c0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fab%252F41abba4c065e15e533dd8e7a58ac874a%252Fpa%252FSZ93699_9b0bb27e165c2390330216f1ad248c86.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/ab/41abba4c065e15e533dd8e7a58ac874a/pa/SZ93699_9b0bb27e165c2390330216f1ad248c86.jpg saved to cache
2026-03-28 12:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 73d7fc43-fb9d-5932-a17a-a2dbfd8793c0
2026-03-28 12:06:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73d7fc43-fb9d-5932-a17a-a2dbfd8793c0, skipping ID generation
2026-03-28 12:06:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73d7fc43-fb9d-5932-a17a-a2dbfd8793c0 with scrape type 1
2026-03-28 12:06:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73d7fc43-fb9d-5932-a17a-a2dbfd8793c0 sending to next pipeline
2026-03-28 12:06:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 73d7fc43-fb9d-5932-a17a-a2dbfd8793c0, identifier: SZ93699
2026-03-28 12:06:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 73d7fc43-fb9d-5932-a17a-a2dbfd8793c0 with identifier: SZ93699
2026-03-28 12:06:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 73d7fc43-fb9d-5932-a17a-a2dbfd8793c0 with identifier: SZ93699
2026-03-28 12:06:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 73d7fc43-fb9d-5932-a17a-a2dbfd8793c0 with identifier: SZ93699 to the API
2026-03-28 12:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img41/ab/41abba4c065e15e533dd8e7a58ac874a/pa/SZ93699_9b0bb27e165c2390330216f1ad248c86.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:05:39Z',
 'fuel_type': 'diesel',
 'id': '73d7fc43-fb9d-5932-a17a-a2dbfd8793c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ93699',
 'listing': 'auction',
 'location': 'IT, Tradein',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 202520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d7fc43-fb9d-5932-a17a-a2dbfd8793c0/73d7fc43-fb9d-5932-a17a-a2dbfd8793c0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/ab/41abba4c065e15e533dd8e7a58ac874a/pa/SZ93699_fa9a5beb01c7557501e675b270cb06c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d7fc43-fb9d-5932-a17a-a2dbfd8793c0/73d7fc43-fb9d-5932-a17a-a2dbfd8793c0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 139158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/ab/41abba4c065e15e533dd8e7a58ac874a/pa/SZ93699_9b0bb27e165c2390330216f1ad248c86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d7fc43-fb9d-5932-a17a-a2dbfd8793c0/73d7fc43-fb9d-5932-a17a-a2dbfd8793c0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/ab/41abba4c065e15e533dd8e7a58ac874a/pa/SZ93699_8951091ffac4ed7131284583b9c04ac7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d7fc43-fb9d-5932-a17a-a2dbfd8793c0/73d7fc43-fb9d-5932-a17a-a2dbfd8793c0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/ab/41abba4c065e15e533dd8e7a58ac874a/pa/SZ93699_02484abe86d729c17e35acd2a77cb84d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d7fc43-fb9d-5932-a17a-a2dbfd8793c0/73d7fc43-fb9d-5932-a17a-a2dbfd8793c0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45266,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/ab/41abba4c065e15e533dd8e7a58ac874a/pa/SZ93699_7bde064678541e03b1f22254a1894c73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d7fc43-fb9d-5932-a17a-a2dbfd8793c0/73d7fc43-fb9d-5932-a17a-a2dbfd8793c0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/ab/41abba4c065e15e533dd8e7a58ac874a/pa/SZ93699_93a508b4866bac850f6245b2b532b402.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-04-10',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.3 JTD Multijet Argento',
 'transmission': 'manual',
 'trim': 'Multijet Argento',
 'year': 2006}
2026-03-28 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SZ93699%27 HTTP/1.1" 200 None
2026-03-28 12:06:35 [auto1.it] INFO: Saving data for SZ93699: {'created_time': 1774699595.032725, 'last_price_update_time': 1774699595.032737, 'auction_closing_time': 1774883139.0}
2026-03-28 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SZ93699') HTTP/1.1" 204 0
2026-03-28 12:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_7f1c5292c2967b2765b11d4b53feeb06.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_f2aa64783d0438a5345a731848ec99fe.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_c68252469b89c52501e1831b64dfccf0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd022910>
2026-03-28 12:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3225aaca-17bf-5e31-964b-d12a780c6b27/3225aaca-17bf-5e31-964b-d12a780c6b27_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fb3%252Fc1b317ca2fd375282532e65a5130627f%252Fpa%252FAL33204_ec892f3db86504e522ec0947de3fb133.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_ec892f3db86504e522ec0947de3fb133.jpg saved to cache
2026-03-28 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3225aaca-17bf-5e31-964b-d12a780c6b27
2026-03-28 12:06:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3225aaca-17bf-5e31-964b-d12a780c6b27, skipping ID generation
2026-03-28 12:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3225aaca-17bf-5e31-964b-d12a780c6b27 with scrape type 1
2026-03-28 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3225aaca-17bf-5e31-964b-d12a780c6b27 sending to next pipeline
2026-03-28 12:06:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3225aaca-17bf-5e31-964b-d12a780c6b27, identifier: AL33204
2026-03-28 12:06:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc670410>
2026-03-28 12:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f35d65-c75a-544a-bcc6-29d77a5b267f/30f35d65-c75a-544a-bcc6-29d77a5b267f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F97%252Fa597a3d71076ca34f9a1fd745e8975d4%252Fpa%252FVU45167_fa16b73f10e6c4214f610e35fdbdf039.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_fa16b73f10e6c4214f610e35fdbdf039.jpg saved to cache
2026-03-28 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 30f35d65-c75a-544a-bcc6-29d77a5b267f
2026-03-28 12:06:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcff6550>
2026-03-28 12:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f35d65-c75a-544a-bcc6-29d77a5b267f/30f35d65-c75a-544a-bcc6-29d77a5b267f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F97%252Fa597a3d71076ca34f9a1fd745e8975d4%252Fpa%252FVU45167_6f121af97fde8a18970ab86342438c7e.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_6f121af97fde8a18970ab86342438c7e.jpg saved to cache
2026-03-28 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30f35d65-c75a-544a-bcc6-29d77a5b267f
2026-03-28 12:06:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bceab490>
2026-03-28 12:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f35d65-c75a-544a-bcc6-29d77a5b267f/30f35d65-c75a-544a-bcc6-29d77a5b267f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F97%252Fa597a3d71076ca34f9a1fd745e8975d4%252Fpa%252FVU45167_eb5149cb1f514b632df2e9b35e76103c.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_eb5149cb1f514b632df2e9b35e76103c.jpg saved to cache
2026-03-28 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 30f35d65-c75a-544a-bcc6-29d77a5b267f
2026-03-28 12:06:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30f35d65-c75a-544a-bcc6-29d77a5b267f, skipping ID generation
2026-03-28 12:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30f35d65-c75a-544a-bcc6-29d77a5b267f with scrape type 1
2026-03-28 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30f35d65-c75a-544a-bcc6-29d77a5b267f sending to next pipeline
2026-03-28 12:06:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 30f35d65-c75a-544a-bcc6-29d77a5b267f, identifier: VU45167
2026-03-28 12:06:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bdd7ce10>
2026-03-28 12:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4e4cb87-df47-57e4-b8ad-6419a1fd3c07/b4e4cb87-df47-57e4-b8ad-6419a1fd3c07_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F62%252Fdb62b21d8b75e15ca8777883db174739%252Fpa%252FVJ26511_dddd342de4b7f4453f32bdbba660e4d5.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_dddd342de4b7f4453f32bdbba660e4d5.jpg saved to cache
2026-03-28 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b4e4cb87-df47-57e4-b8ad-6419a1fd3c07
2026-03-28 12:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcff40d0>
2026-03-28 12:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b437e8b-a37a-53ec-8205-69705c9ab3cb/5b437e8b-a37a-53ec-8205-69705c9ab3cb_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F39%252F8a39ab45a3258320dc9f2f2ca4330fea%252Fpa%252FDV86201_319b26c10013ccdfad341e94f0abc7c7.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_319b26c10013ccdfad341e94f0abc7c7.jpg saved to cache
2026-03-28 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5b437e8b-a37a-53ec-8205-69705c9ab3cb
2026-03-28 12:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bf1c3450>
2026-03-28 12:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b437e8b-a37a-53ec-8205-69705c9ab3cb/5b437e8b-a37a-53ec-8205-69705c9ab3cb_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F39%252F8a39ab45a3258320dc9f2f2ca4330fea%252Fpa%252FDV86201_ba1c811c4371789c43bde90f65473d23.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_ba1c811c4371789c43bde90f65473d23.jpg saved to cache
2026-03-28 12:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5b437e8b-a37a-53ec-8205-69705c9ab3cb
2026-03-28 12:06:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3225aaca-17bf-5e31-964b-d12a780c6b27 with identifier: AL33204
2026-03-28 12:06:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3225aaca-17bf-5e31-964b-d12a780c6b27 with identifier: AL33204
2026-03-28 12:06:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3225aaca-17bf-5e31-964b-d12a780c6b27 with identifier: AL33204 to the API
2026-03-28 12:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_ec892f3db86504e522ec0947de3fb133.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:45:39Z',
 'fuel_type': 'petrol',
 'id': '3225aaca-17bf-5e31-964b-d12a780c6b27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL33204',
 'listing': 'auction',
 'location': 'IT, Tradein',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 120262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3225aaca-17bf-5e31-964b-d12a780c6b27/3225aaca-17bf-5e31-964b-d12a780c6b27_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2046853,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_ec892f3db86504e522ec0947de3fb133.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3225aaca-17bf-5e31-964b-d12a780c6b27/3225aaca-17bf-5e31-964b-d12a780c6b27_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_0b2a0b76afbcab350ac5e1efb14c5eca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3225aaca-17bf-5e31-964b-d12a780c6b27/3225aaca-17bf-5e31-964b-d12a780c6b27_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_05c1cfebab3be390ab6d8f4012e481c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3225aaca-17bf-5e31-964b-d12a780c6b27/3225aaca-17bf-5e31-964b-d12a780c6b27_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2038185,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_23bbc4e13a7b0e3ce245715f5b62bb49.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3225aaca-17bf-5e31-964b-d12a780c6b27/3225aaca-17bf-5e31-964b-d12a780c6b27_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52771,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_a2b4044cd08eac16d2861f31b75db3b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3225aaca-17bf-5e31-964b-d12a780c6b27/3225aaca-17bf-5e31-964b-d12a780c6b27_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_189ac0f8e207cca595f9d4866bb0310a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3225aaca-17bf-5e31-964b-d12a780c6b27/3225aaca-17bf-5e31-964b-d12a780c6b27_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_25a9729cf8aee5c4c110a5e029e37ab7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3225aaca-17bf-5e31-964b-d12a780c6b27/3225aaca-17bf-5e31-964b-d12a780c6b27_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_394f119855b3628de9eb326c083df8b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3225aaca-17bf-5e31-964b-d12a780c6b27/3225aaca-17bf-5e31-964b-d12a780c6b27_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_5d2d94c402ded8cf0b528ee341a34414.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3225aaca-17bf-5e31-964b-d12a780c6b27/3225aaca-17bf-5e31-964b-d12a780c6b27_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2457627,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/b3/c1b317ca2fd375282532e65a5130627f/pa/AL33204_4e6f396cbd7ebdd1c1a9f7353c665f47.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.2 Gold',
 'transmission': 'manual',
 'trim': 'Gold',
 'year': 2016}
2026-03-28 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL33204%27 HTTP/1.1" 200 None
2026-03-28 12:06:36 [auto1.it] INFO: Saving data for AL33204: {'created_time': 1774699596.224185, 'last_price_update_time': 1774699596.224197, 'auction_closing_time': 1774885539.0}
2026-03-28 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AL33204') HTTP/1.1" 204 0
2026-03-28 12:06:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 30f35d65-c75a-544a-bcc6-29d77a5b267f with identifier: VU45167
2026-03-28 12:06:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 30f35d65-c75a-544a-bcc6-29d77a5b267f with identifier: VU45167
2026-03-28 12:06:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 30f35d65-c75a-544a-bcc6-29d77a5b267f with identifier: VU45167 to the API
2026-03-28 12:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_eb5149cb1f514b632df2e9b35e76103c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:12:04Z',
 'fuel_type': 'diesel',
 'id': '30f35d65-c75a-544a-bcc6-29d77a5b267f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU45167',
 'listing': 'auction',
 'location': 'IT, Caltanissetta',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 175807,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f35d65-c75a-544a-bcc6-29d77a5b267f/30f35d65-c75a-544a-bcc6-29d77a5b267f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2107197,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_6f121af97fde8a18970ab86342438c7e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f35d65-c75a-544a-bcc6-29d77a5b267f/30f35d65-c75a-544a-bcc6-29d77a5b267f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2071259,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_fa16b73f10e6c4214f610e35fdbdf039.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f35d65-c75a-544a-bcc6-29d77a5b267f/30f35d65-c75a-544a-bcc6-29d77a5b267f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2129164,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_eb5149cb1f514b632df2e9b35e76103c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f35d65-c75a-544a-bcc6-29d77a5b267f/30f35d65-c75a-544a-bcc6-29d77a5b267f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_4a06f37229ba05e807f72b59b6f8c6c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f35d65-c75a-544a-bcc6-29d77a5b267f/30f35d65-c75a-544a-bcc6-29d77a5b267f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1942538,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_0955b55d7431518482381adabff3285c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f35d65-c75a-544a-bcc6-29d77a5b267f/30f35d65-c75a-544a-bcc6-29d77a5b267f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1947073,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_e979e6c155d24fed1b83b5b619f29103.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f35d65-c75a-544a-bcc6-29d77a5b267f/30f35d65-c75a-544a-bcc6-29d77a5b267f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_fffafc374460344fb5963c64f0d6d226.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f35d65-c75a-544a-bcc6-29d77a5b267f/30f35d65-c75a-544a-bcc6-29d77a5b267f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_52ec737b42e3f2fd8426e1350c56bce7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f35d65-c75a-544a-bcc6-29d77a5b267f/30f35d65-c75a-544a-bcc6-29d77a5b267f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_7c68f6284b34de2d01bb07ddeaa67984.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f35d65-c75a-544a-bcc6-29d77a5b267f/30f35d65-c75a-544a-bcc6-29d77a5b267f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2122414,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/97/a597a3d71076ca34f9a1fd745e8975d4/pa/VU45167_ab08134f2b1ad24a55edccde29cd640b.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-08-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2014}
2026-03-28 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU45167%27 HTTP/1.1" 200 None
2026-03-28 12:06:36 [auto1.it] INFO: Saving data for VU45167: {'created_time': 1774699596.602416, 'last_price_update_time': 1774699596.602426, 'auction_closing_time': 1774883524.0}
2026-03-28 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VU45167') HTTP/1.1" 204 0
2026-03-28 12:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_da9cfb5df3648d210a030672e5feadf9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04cb66b350>
2026-03-28 12:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4e4cb87-df47-57e4-b8ad-6419a1fd3c07/b4e4cb87-df47-57e4-b8ad-6419a1fd3c07_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F62%252Fdb62b21d8b75e15ca8777883db174739%252Fpa%252FVJ26511_7f1c5292c2967b2765b11d4b53feeb06.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_7f1c5292c2967b2765b11d4b53feeb06.jpg saved to cache
2026-03-28 12:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b4e4cb87-df47-57e4-b8ad-6419a1fd3c07
2026-03-28 12:06:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b4e4cb87-df47-57e4-b8ad-6419a1fd3c07, skipping ID generation
2026-03-28 12:06:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4e4cb87-df47-57e4-b8ad-6419a1fd3c07 with scrape type 1
2026-03-28 12:06:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4e4cb87-df47-57e4-b8ad-6419a1fd3c07 sending to next pipeline
2026-03-28 12:06:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b4e4cb87-df47-57e4-b8ad-6419a1fd3c07, identifier: VJ26511
2026-03-28 12:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bceb59d0>
2026-03-28 12:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99331b19-07da-57c2-8f19-2bf79e0ae01c/99331b19-07da-57c2-8f19-2bf79e0ae01c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fda%252F51dac849c5c7fed6fd1d19543af9859a%252Fpa%252FLC50167_f2aa64783d0438a5345a731848ec99fe.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_f2aa64783d0438a5345a731848ec99fe.jpg saved to cache
2026-03-28 12:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 99331b19-07da-57c2-8f19-2bf79e0ae01c
2026-03-28 12:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bf1c11d0>
2026-03-28 12:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99331b19-07da-57c2-8f19-2bf79e0ae01c/99331b19-07da-57c2-8f19-2bf79e0ae01c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fda%252F51dac849c5c7fed6fd1d19543af9859a%252Fpa%252FLC50167_c68252469b89c52501e1831b64dfccf0.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_c68252469b89c52501e1831b64dfccf0.jpg saved to cache
2026-03-28 12:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 99331b19-07da-57c2-8f19-2bf79e0ae01c
2026-03-28 12:06:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 99331b19-07da-57c2-8f19-2bf79e0ae01c, skipping ID generation
2026-03-28 12:06:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99331b19-07da-57c2-8f19-2bf79e0ae01c with scrape type 1
2026-03-28 12:06:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99331b19-07da-57c2-8f19-2bf79e0ae01c sending to next pipeline
2026-03-28 12:06:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 99331b19-07da-57c2-8f19-2bf79e0ae01c, identifier: LC50167
2026-03-28 12:06:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b4e4cb87-df47-57e4-b8ad-6419a1fd3c07 with identifier: VJ26511
2026-03-28 12:06:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b4e4cb87-df47-57e4-b8ad-6419a1fd3c07 with identifier: VJ26511
2026-03-28 12:06:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b4e4cb87-df47-57e4-b8ad-6419a1fd3c07 with identifier: VJ26511 to the API
2026-03-28 12:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_7f1c5292c2967b2765b11d4b53feeb06.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:07:56Z',
 'fuel_type': 'diesel',
 'id': 'b4e4cb87-df47-57e4-b8ad-6419a1fd3c07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ26511',
 'listing': 'auction',
 'location': 'IT, Legnano',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 162188,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4e4cb87-df47-57e4-b8ad-6419a1fd3c07/b4e4cb87-df47-57e4-b8ad-6419a1fd3c07_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69081,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_7d97a0062e77ad538c868167bf88f454.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4e4cb87-df47-57e4-b8ad-6419a1fd3c07/b4e4cb87-df47-57e4-b8ad-6419a1fd3c07_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_7f1c5292c2967b2765b11d4b53feeb06.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4e4cb87-df47-57e4-b8ad-6419a1fd3c07/b4e4cb87-df47-57e4-b8ad-6419a1fd3c07_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_c9fc8f65caab6a749c188c88ee199f5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4e4cb87-df47-57e4-b8ad-6419a1fd3c07/b4e4cb87-df47-57e4-b8ad-6419a1fd3c07_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_92486d378eb955640e14c23877876dee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4e4cb87-df47-57e4-b8ad-6419a1fd3c07/b4e4cb87-df47-57e4-b8ad-6419a1fd3c07_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2612059,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_dddd342de4b7f4453f32bdbba660e4d5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4e4cb87-df47-57e4-b8ad-6419a1fd3c07/b4e4cb87-df47-57e4-b8ad-6419a1fd3c07_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72813,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_2627b4766b6e5c41d40ea028818fa5ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4e4cb87-df47-57e4-b8ad-6419a1fd3c07/b4e4cb87-df47-57e4-b8ad-6419a1fd3c07_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2728359,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_2a7696a63446033ee12270a46e54cf7c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4e4cb87-df47-57e4-b8ad-6419a1fd3c07/b4e4cb87-df47-57e4-b8ad-6419a1fd3c07_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_219eed5c454f4dc5381eda12a545db59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4e4cb87-df47-57e4-b8ad-6419a1fd3c07/b4e4cb87-df47-57e4-b8ad-6419a1fd3c07_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2566402,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_d35fc242d157e4a6311cd2d311d50976.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4e4cb87-df47-57e4-b8ad-6419a1fd3c07/b4e4cb87-df47-57e4-b8ad-6419a1fd3c07_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2510471,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/62/db62b21d8b75e15ca8777883db174739/pa/VJ26511_66231fc5800739c9d50fdecdd74645d4.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.6 TDI Admired',
 'transmission': 'manual',
 'trim': 'Admired',
 'year': 2013}
2026-03-28 12:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ26511%27 HTTP/1.1" 200 None
2026-03-28 12:06:37 [auto1.it] INFO: Saving data for VJ26511: {'created_time': 1774699597.372339, 'last_price_update_time': 1774699597.37235, 'auction_closing_time': 1774883276.0}
2026-03-28 12:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VJ26511') HTTP/1.1" 204 0
2026-03-28 12:06:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 99331b19-07da-57c2-8f19-2bf79e0ae01c with identifier: LC50167
2026-03-28 12:06:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 99331b19-07da-57c2-8f19-2bf79e0ae01c with identifier: LC50167
2026-03-28 12:06:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 99331b19-07da-57c2-8f19-2bf79e0ae01c with identifier: LC50167 to the API
2026-03-28 12:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_c68252469b89c52501e1831b64dfccf0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:56:42Z',
 'fuel_type': 'diesel',
 'id': '99331b19-07da-57c2-8f19-2bf79e0ae01c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC50167',
 'listing': 'auction',
 'location': 'IT, Brescia',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 173084,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99331b19-07da-57c2-8f19-2bf79e0ae01c/99331b19-07da-57c2-8f19-2bf79e0ae01c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_22ff957baefd8b5cf0f4b6d965584da5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99331b19-07da-57c2-8f19-2bf79e0ae01c/99331b19-07da-57c2-8f19-2bf79e0ae01c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2582021,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_2d70c3213205872e90ec23134916d59d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99331b19-07da-57c2-8f19-2bf79e0ae01c/99331b19-07da-57c2-8f19-2bf79e0ae01c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_c68252469b89c52501e1831b64dfccf0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99331b19-07da-57c2-8f19-2bf79e0ae01c/99331b19-07da-57c2-8f19-2bf79e0ae01c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_08298882697f2fa719a1314a3d1ab4c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99331b19-07da-57c2-8f19-2bf79e0ae01c/99331b19-07da-57c2-8f19-2bf79e0ae01c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2484490,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_e95bfc8b4f261cb48e2115cd3497e7f3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99331b19-07da-57c2-8f19-2bf79e0ae01c/99331b19-07da-57c2-8f19-2bf79e0ae01c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1890362,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_b90faeefcf617870a5f03b2d68d0a701.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99331b19-07da-57c2-8f19-2bf79e0ae01c/99331b19-07da-57c2-8f19-2bf79e0ae01c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44464,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_f2aa64783d0438a5345a731848ec99fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99331b19-07da-57c2-8f19-2bf79e0ae01c/99331b19-07da-57c2-8f19-2bf79e0ae01c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_90ba91690457ae4057cb86220a7e03bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99331b19-07da-57c2-8f19-2bf79e0ae01c/99331b19-07da-57c2-8f19-2bf79e0ae01c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_8cb0107ab0c1959c3efa77165b672040.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99331b19-07da-57c2-8f19-2bf79e0ae01c/99331b19-07da-57c2-8f19-2bf79e0ae01c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/da/51dac849c5c7fed6fd1d19543af9859a/pa/LC50167_a75d50a595c8a8eab40b0387d88d9b95.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-01-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2010}
2026-03-28 12:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC50167%27 HTTP/1.1" 200 None
2026-03-28 12:06:37 [auto1.it] INFO: Saving data for LC50167: {'created_time': 1774699597.73112, 'last_price_update_time': 1774699597.73113, 'auction_closing_time': 1774886202.0}
2026-03-28 12:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LC50167') HTTP/1.1" 204 0
2026-03-28 12:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RX99129> (referer: https://www.auto1.com/v1/car-details-view/RX99129/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfb0a50>
2026-03-28 12:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7db5a3-4d0d-5f29-a092-d00e71c3962e/1f7db5a3-4d0d-5f29-a092-d00e71c3962e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F9d%252F3b9d98fef86238b278f78ff9754d5ffa%252Fpa%252FLF71839_da9cfb5df3648d210a030672e5feadf9.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_da9cfb5df3648d210a030672e5feadf9.jpg saved to cache
2026-03-28 12:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1f7db5a3-4d0d-5f29-a092-d00e71c3962e
2026-03-28 12:06:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_c52abcec616793c3860af696cdf4faf5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_0f982f8b746d675af827fc0c279a21be.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_4b6d3ee2b797f5e063d3b14004efb2c6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_2bac01db1361e3f1be885b7527421152.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_4c937060fa8bd66ba856cadaf5815937.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6b60628-4f3c-5d4a-a89d-a2a00f9c5318 with identifier: RX99129
2026-03-28 12:06:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6b60628-4f3c-5d4a-a89d-a2a00f9c5318 with scrape type 1
2026-03-28 12:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f6b60628-4f3c-5d4a-a89d-a2a00f9c5318
2026-03-28 12:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F23%252Fae236281bbf1f5649f30d3cbb1017f93%252Fpa%252FRX99129_25fbb9f15fd91d3bf81ac8cbca124219.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_25fbb9f15fd91d3bf81ac8cbca124219.jpg not downloaded yet
2026-03-28 12:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F23%252Fae236281bbf1f5649f30d3cbb1017f93%252Fpa%252FRX99129_2bf4786707e54a43ef6c4b6b9ac00328.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_2bf4786707e54a43ef6c4b6b9ac00328.jpg not downloaded yet
2026-03-28 12:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F23%252Fae236281bbf1f5649f30d3cbb1017f93%252Fpa%252FRX99129_ac11ca91085f12aa5d3b3c6a46fafbaa.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_ac11ca91085f12aa5d3b3c6a46fafbaa.jpg not downloaded yet
2026-03-28 12:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_8570d3539bf063139e237f008154e580.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F23%252Fae236281bbf1f5649f30d3cbb1017f93%252Fpa%252FRX99129_5dbd09f70bbef93ea5c6e08197ab2cb1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_5dbd09f70bbef93ea5c6e08197ab2cb1.jpg not downloaded yet
2026-03-28 12:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_9f51835283c123b09e10ca09f726c946.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_b3f61d7de082dbc7f99c5a20406e1ecd.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F23%252Fae236281bbf1f5649f30d3cbb1017f93%252Fpa%252FRX99129_429aee183698da864cc54d72ef7c498a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_429aee183698da864cc54d72ef7c498a.jpg not downloaded yet
2026-03-28 12:06:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3cf210>
2026-03-28 12:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b437e8b-a37a-53ec-8205-69705c9ab3cb/5b437e8b-a37a-53ec-8205-69705c9ab3cb_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F39%252F8a39ab45a3258320dc9f2f2ca4330fea%252Fpa%252FDV86201_c52abcec616793c3860af696cdf4faf5.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_c52abcec616793c3860af696cdf4faf5.jpg saved to cache
2026-03-28 12:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5b437e8b-a37a-53ec-8205-69705c9ab3cb
2026-03-28 12:06:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5b437e8b-a37a-53ec-8205-69705c9ab3cb, skipping ID generation
2026-03-28 12:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b437e8b-a37a-53ec-8205-69705c9ab3cb with scrape type 1
2026-03-28 12:06:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5b437e8b-a37a-53ec-8205-69705c9ab3cb sending to next pipeline
2026-03-28 12:06:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5b437e8b-a37a-53ec-8205-69705c9ab3cb, identifier: DV86201
2026-03-28 12:06:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04ccb76850>
2026-03-28 12:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7db5a3-4d0d-5f29-a092-d00e71c3962e/1f7db5a3-4d0d-5f29-a092-d00e71c3962e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F9d%252F3b9d98fef86238b278f78ff9754d5ffa%252Fpa%252FLF71839_0f982f8b746d675af827fc0c279a21be.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_0f982f8b746d675af827fc0c279a21be.jpg saved to cache
2026-03-28 12:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1f7db5a3-4d0d-5f29-a092-d00e71c3962e
2026-03-28 12:06:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc50a810>
2026-03-28 12:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7db5a3-4d0d-5f29-a092-d00e71c3962e/1f7db5a3-4d0d-5f29-a092-d00e71c3962e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F9d%252F3b9d98fef86238b278f78ff9754d5ffa%252Fpa%252FLF71839_4b6d3ee2b797f5e063d3b14004efb2c6.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_4b6d3ee2b797f5e063d3b14004efb2c6.jpg saved to cache
2026-03-28 12:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1f7db5a3-4d0d-5f29-a092-d00e71c3962e
2026-03-28 12:06:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf17a50>
2026-03-28 12:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7db5a3-4d0d-5f29-a092-d00e71c3962e/1f7db5a3-4d0d-5f29-a092-d00e71c3962e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F9d%252F3b9d98fef86238b278f78ff9754d5ffa%252Fpa%252FLF71839_2bac01db1361e3f1be885b7527421152.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_2bac01db1361e3f1be885b7527421152.jpg saved to cache
2026-03-28 12:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1f7db5a3-4d0d-5f29-a092-d00e71c3962e
2026-03-28 12:06:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd073850>
2026-03-28 12:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7db5a3-4d0d-5f29-a092-d00e71c3962e/1f7db5a3-4d0d-5f29-a092-d00e71c3962e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F9d%252F3b9d98fef86238b278f78ff9754d5ffa%252Fpa%252FLF71839_4c937060fa8bd66ba856cadaf5815937.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_4c937060fa8bd66ba856cadaf5815937.jpg saved to cache
2026-03-28 12:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1f7db5a3-4d0d-5f29-a092-d00e71c3962e
2026-03-28 12:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F23%252Fae236281bbf1f5649f30d3cbb1017f93%252Fpa%252FRX99129_d778b0507335f41225fc2648063091db.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_d778b0507335f41225fc2648063091db.jpg not downloaded yet
2026-03-28 12:06:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5b437e8b-a37a-53ec-8205-69705c9ab3cb with identifier: DV86201
2026-03-28 12:06:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5b437e8b-a37a-53ec-8205-69705c9ab3cb with identifier: DV86201
2026-03-28 12:06:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5b437e8b-a37a-53ec-8205-69705c9ab3cb with identifier: DV86201 to the API
2026-03-28 12:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_c52abcec616793c3860af696cdf4faf5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:44:12Z',
 'fuel_type': 'diesel',
 'id': '5b437e8b-a37a-53ec-8205-69705c9ab3cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV86201',
 'listing': 'auction',
 'location': 'IT, Modugno',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 136949,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b437e8b-a37a-53ec-8205-69705c9ab3cb/5b437e8b-a37a-53ec-8205-69705c9ab3cb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_319b26c10013ccdfad341e94f0abc7c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b437e8b-a37a-53ec-8205-69705c9ab3cb/5b437e8b-a37a-53ec-8205-69705c9ab3cb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59691,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_ba1c811c4371789c43bde90f65473d23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b437e8b-a37a-53ec-8205-69705c9ab3cb/5b437e8b-a37a-53ec-8205-69705c9ab3cb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2445167,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_c52abcec616793c3860af696cdf4faf5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b437e8b-a37a-53ec-8205-69705c9ab3cb/5b437e8b-a37a-53ec-8205-69705c9ab3cb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2552704,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_35f44843d72d7338ee4cedfdc6243d29.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b437e8b-a37a-53ec-8205-69705c9ab3cb/5b437e8b-a37a-53ec-8205-69705c9ab3cb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_fa88a2c1a64c4e62950bbd0521641a0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b437e8b-a37a-53ec-8205-69705c9ab3cb/5b437e8b-a37a-53ec-8205-69705c9ab3cb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_9419d016992b867e703b39d5590a12b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b437e8b-a37a-53ec-8205-69705c9ab3cb/5b437e8b-a37a-53ec-8205-69705c9ab3cb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_2c95d70d5b829817e4bd067a13551bea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b437e8b-a37a-53ec-8205-69705c9ab3cb/5b437e8b-a37a-53ec-8205-69705c9ab3cb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_63f196522e4961a62d3225168589de26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b437e8b-a37a-53ec-8205-69705c9ab3cb/5b437e8b-a37a-53ec-8205-69705c9ab3cb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2557964,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_1baddf7e956269f5f572ec6d81b87470.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b437e8b-a37a-53ec-8205-69705c9ab3cb/5b437e8b-a37a-53ec-8205-69705c9ab3cb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52007,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/39/8a39ab45a3258320dc9f2f2ca4330fea/pa/DV86201_44b582aa276aa104e0bea7ccf57c75e0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2011}
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV86201%27 HTTP/1.1" 200 None
2026-03-28 12:06:39 [auto1.it] INFO: Saving data for DV86201: {'created_time': 1774699599.098912, 'last_price_update_time': 1774699599.098924, 'auction_closing_time': 1774885452.0}
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DV86201') HTTP/1.1" 204 0
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F23%252Fae236281bbf1f5649f30d3cbb1017f93%252Fpa%252FRX99129_84b8fd46012273fd36f29325fcf6f6ee.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_84b8fd46012273fd36f29325fcf6f6ee.jpg not downloaded yet
2026-03-28 12:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PR73005> (referer: https://www.auto1.com/v1/car-details-view/PR73005/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VU78996> (referer: https://www.auto1.com/v1/car-details-view/VU78996/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FN08703/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KV81214> (referer: https://www.auto1.com/v1/car-details-view/KV81214/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AY38539/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EG76959/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcea8550>
2026-03-28 12:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7db5a3-4d0d-5f29-a092-d00e71c3962e/1f7db5a3-4d0d-5f29-a092-d00e71c3962e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F9d%252F3b9d98fef86238b278f78ff9754d5ffa%252Fpa%252FLF71839_8570d3539bf063139e237f008154e580.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_8570d3539bf063139e237f008154e580.jpg saved to cache
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1f7db5a3-4d0d-5f29-a092-d00e71c3962e
2026-03-28 12:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfeb350>
2026-03-28 12:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7db5a3-4d0d-5f29-a092-d00e71c3962e/1f7db5a3-4d0d-5f29-a092-d00e71c3962e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F9d%252F3b9d98fef86238b278f78ff9754d5ffa%252Fpa%252FLF71839_9f51835283c123b09e10ca09f726c946.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_9f51835283c123b09e10ca09f726c946.jpg saved to cache
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1f7db5a3-4d0d-5f29-a092-d00e71c3962e
2026-03-28 12:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3d4990>
2026-03-28 12:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7db5a3-4d0d-5f29-a092-d00e71c3962e/1f7db5a3-4d0d-5f29-a092-d00e71c3962e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F9d%252F3b9d98fef86238b278f78ff9754d5ffa%252Fpa%252FLF71839_b3f61d7de082dbc7f99c5a20406e1ecd.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_b3f61d7de082dbc7f99c5a20406e1ecd.jpg saved to cache
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1f7db5a3-4d0d-5f29-a092-d00e71c3962e
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F23%252Fae236281bbf1f5649f30d3cbb1017f93%252Fpa%252FRX99129_68fcfa2335b45742272e2e2b334e805f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_68fcfa2335b45742272e2e2b334e805f.jpg not downloaded yet
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F23%252Fae236281bbf1f5649f30d3cbb1017f93%252Fpa%252FRX99129_62cefddd0b15f26c2ec5720ff3c3a195.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_62cefddd0b15f26c2ec5720ff3c3a195.jpg not downloaded yet
2026-03-28 12:06:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 226ea16f-8e4c-5c8c-8029-e732542d307f with identifier: PR73005
2026-03-28 12:06:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 226ea16f-8e4c-5c8c-8029-e732542d307f with scrape type 1
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 226ea16f-8e4c-5c8c-8029-e732542d307f
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F38%252F40380e14f263dd4a58844d0c434613aa%252Fpa%252FPR73005_719ddd68f497b64d8b212daa0e8b67b6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_719ddd68f497b64d8b212daa0e8b67b6.jpg not downloaded yet
2026-03-28 12:06:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fd24d2e-c7a4-5e24-94aa-abb81314b2a2 with identifier: VU78996
2026-03-28 12:06:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fd24d2e-c7a4-5e24-94aa-abb81314b2a2 with scrape type 1
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7fd24d2e-c7a4-5e24-94aa-abb81314b2a2
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F4d%252F5c4dda21beac1477e02dd63c090b78c9%252Fpa%252FVU78996_f302ab680e79024021c22b6813f8bbe7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_f302ab680e79024021c22b6813f8bbe7.jpg not downloaded yet
2026-03-28 12:06:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3274a6e0-0b1a-5aba-a406-beb335beeeee with identifier: KV81214
2026-03-28 12:06:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3274a6e0-0b1a-5aba-a406-beb335beeeee with scrape type 1
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3274a6e0-0b1a-5aba-a406-beb335beeeee
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F6c%252Fb06c97d8b1deae9be098e8feb68c95cf%252Fpa%252FKV81214_c3e01b59336097fe595549c330463a56.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_c3e01b59336097fe595549c330463a56.jpg not downloaded yet
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F23%252Fae236281bbf1f5649f30d3cbb1017f93%252Fpa%252FRX99129_793ac037ae8f610a8c2d445df8cb1ac5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_793ac037ae8f610a8c2d445df8cb1ac5.jpg not downloaded yet
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F38%252F40380e14f263dd4a58844d0c434613aa%252Fpa%252FPR73005_d9b3036d020384cba6103b3dbfddda97.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_d9b3036d020384cba6103b3dbfddda97.jpg not downloaded yet
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F4d%252F5c4dda21beac1477e02dd63c090b78c9%252Fpa%252FVU78996_ce57f0e60e03b996bd8372dab1bbb9da.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_ce57f0e60e03b996bd8372dab1bbb9da.jpg not downloaded yet
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F6c%252Fb06c97d8b1deae9be098e8feb68c95cf%252Fpa%252FKV81214_6cd44bb293469f5a6d4a30626333ba1f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_6cd44bb293469f5a6d4a30626333ba1f.jpg not downloaded yet
2026-03-28 12:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_25fbb9f15fd91d3bf81ac8cbca124219.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F38%252F40380e14f263dd4a58844d0c434613aa%252Fpa%252FPR73005_890db421af44164579b4b3a37cafd743.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_890db421af44164579b4b3a37cafd743.jpg not downloaded yet
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F4d%252F5c4dda21beac1477e02dd63c090b78c9%252Fpa%252FVU78996_e273b381e53d46ff9c1ab26632080c1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_e273b381e53d46ff9c1ab26632080c1b.jpg not downloaded yet
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F6c%252Fb06c97d8b1deae9be098e8feb68c95cf%252Fpa%252FKV81214_c4546f9a0f561506b6a6c5b4f978f798.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_c4546f9a0f561506b6a6c5b4f978f798.jpg not downloaded yet
2026-03-28 12:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_2bf4786707e54a43ef6c4b6b9ac00328.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_d556588c082306a67afde73ae277543f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F38%252F40380e14f263dd4a58844d0c434613aa%252Fpa%252FPR73005_d33315daa1e0364eca77cb5f3218c2cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_d33315daa1e0364eca77cb5f3218c2cc.jpg not downloaded yet
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F4d%252F5c4dda21beac1477e02dd63c090b78c9%252Fpa%252FVU78996_58f294f5f00d7fb77e6f470df98a500c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_58f294f5f00d7fb77e6f470df98a500c.jpg not downloaded yet
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F6c%252Fb06c97d8b1deae9be098e8feb68c95cf%252Fpa%252FKV81214_454bd6223551c6e3da153266c3be9842.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_454bd6223551c6e3da153266c3be9842.jpg not downloaded yet
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F38%252F40380e14f263dd4a58844d0c434613aa%252Fpa%252FPR73005_00c451b6d3564b601b6ace810cd3d0e4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_00c451b6d3564b601b6ace810cd3d0e4.jpg not downloaded yet
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F4d%252F5c4dda21beac1477e02dd63c090b78c9%252Fpa%252FVU78996_6d2c960c88e7b008e34ec61e3ba78c2e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_6d2c960c88e7b008e34ec61e3ba78c2e.jpg not downloaded yet
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F6c%252Fb06c97d8b1deae9be098e8feb68c95cf%252Fpa%252FKV81214_1d3254cf69cf95a1dce478b20f706fd5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_1d3254cf69cf95a1dce478b20f706fd5.jpg not downloaded yet
2026-03-28 12:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04beed9290>
2026-03-28 12:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b60628-4f3c-5d4a-a89d-a2a00f9c5318/f6b60628-4f3c-5d4a-a89d-a2a00f9c5318_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F23%252Fae236281bbf1f5649f30d3cbb1017f93%252Fpa%252FRX99129_25fbb9f15fd91d3bf81ac8cbca124219.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_25fbb9f15fd91d3bf81ac8cbca124219.jpg saved to cache
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f6b60628-4f3c-5d4a-a89d-a2a00f9c5318
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F38%252F40380e14f263dd4a58844d0c434613aa%252Fpa%252FPR73005_8b6ff080d5295c06d3e931d4aadd280d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_8b6ff080d5295c06d3e931d4aadd280d.jpg not downloaded yet
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F4d%252F5c4dda21beac1477e02dd63c090b78c9%252Fpa%252FVU78996_a40f63d240efad16b1bc89d1286e3973.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_a40f63d240efad16b1bc89d1286e3973.jpg not downloaded yet
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F6c%252Fb06c97d8b1deae9be098e8feb68c95cf%252Fpa%252FKV81214_31b1431ffb8a862102a7eb5a83f09bf7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_31b1431ffb8a862102a7eb5a83f09bf7.jpg not downloaded yet
2026-03-28 12:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3776d0>
2026-03-28 12:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b60628-4f3c-5d4a-a89d-a2a00f9c5318/f6b60628-4f3c-5d4a-a89d-a2a00f9c5318_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F23%252Fae236281bbf1f5649f30d3cbb1017f93%252Fpa%252FRX99129_2bf4786707e54a43ef6c4b6b9ac00328.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_2bf4786707e54a43ef6c4b6b9ac00328.jpg saved to cache
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f6b60628-4f3c-5d4a-a89d-a2a00f9c5318
2026-03-28 12:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcea3190>
2026-03-28 12:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1540861-55d8-5622-83cc-65661a4f82a9/f1540861-55d8-5622-83cc-65661a4f82a9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ffa%252Fb0fa5fe76c0edb84d6f2dd581689e2ef%252Fpa%252FFR55532_d556588c082306a67afde73ae277543f.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_d556588c082306a67afde73ae277543f.jpg saved to cache
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f1540861-55d8-5622-83cc-65661a4f82a9
2026-03-28 12:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_ce57f0e60e03b996bd8372dab1bbb9da.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F38%252F40380e14f263dd4a58844d0c434613aa%252Fpa%252FPR73005_2b0e97886732499b7ce4088c82a0e5e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_2b0e97886732499b7ce4088c82a0e5e2.jpg not downloaded yet
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F4d%252F5c4dda21beac1477e02dd63c090b78c9%252Fpa%252FVU78996_2437d584f6843094b7db146ffc3c188c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_2437d584f6843094b7db146ffc3c188c.jpg not downloaded yet
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F6c%252Fb06c97d8b1deae9be098e8feb68c95cf%252Fpa%252FKV81214_d80e9d2f13ee6986aa90e5c9b3aad1d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_d80e9d2f13ee6986aa90e5c9b3aad1d2.jpg not downloaded yet
2026-03-28 12:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_6cd44bb293469f5a6d4a30626333ba1f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F38%252F40380e14f263dd4a58844d0c434613aa%252Fpa%252FPR73005_61c1b42fe8a7ce81d5c56b22f7b9e0ed.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_61c1b42fe8a7ce81d5c56b22f7b9e0ed.jpg not downloaded yet
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F4d%252F5c4dda21beac1477e02dd63c090b78c9%252Fpa%252FVU78996_300d63709fb34ebc1c929aecf3ee6b4e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_300d63709fb34ebc1c929aecf3ee6b4e.jpg not downloaded yet
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F6c%252Fb06c97d8b1deae9be098e8feb68c95cf%252Fpa%252FKV81214_cc019a1033e68571809600675ea4bef4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_cc019a1033e68571809600675ea4bef4.jpg not downloaded yet
2026-03-28 12:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PK33610/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F38%252F40380e14f263dd4a58844d0c434613aa%252Fpa%252FPR73005_a1f20cb3f14562e0d9858db7c7712696.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_a1f20cb3f14562e0d9858db7c7712696.jpg not downloaded yet
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F4d%252F5c4dda21beac1477e02dd63c090b78c9%252Fpa%252FVU78996_55c490e4d646390b31c58a5c93486ba6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_55c490e4d646390b31c58a5c93486ba6.jpg not downloaded yet
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F6c%252Fb06c97d8b1deae9be098e8feb68c95cf%252Fpa%252FKV81214_13b61f9190063883faf5719181c051cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_13b61f9190063883faf5719181c051cc.jpg not downloaded yet
2026-03-28 12:06:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F38%252F40380e14f263dd4a58844d0c434613aa%252Fpa%252FPR73005_6a6ebbe996f1c609ad122ad09b1ab209.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_6a6ebbe996f1c609ad122ad09b1ab209.jpg not downloaded yet
2026-03-28 12:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F4d%252F5c4dda21beac1477e02dd63c090b78c9%252Fpa%252FVU78996_623a7fcde1de497936ddd0839bb3a99a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_623a7fcde1de497936ddd0839bb3a99a.jpg not downloaded yet
2026-03-28 12:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F6c%252Fb06c97d8b1deae9be098e8feb68c95cf%252Fpa%252FKV81214_ca954c71bcacaa94e45f77f11898a61a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_ca954c71bcacaa94e45f77f11898a61a.jpg not downloaded yet
2026-03-28 12:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf39910>
2026-03-28 12:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fd24d2e-c7a4-5e24-94aa-abb81314b2a2/7fd24d2e-c7a4-5e24-94aa-abb81314b2a2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F4d%252F5c4dda21beac1477e02dd63c090b78c9%252Fpa%252FVU78996_ce57f0e60e03b996bd8372dab1bbb9da.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_ce57f0e60e03b996bd8372dab1bbb9da.jpg saved to cache
2026-03-28 12:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7fd24d2e-c7a4-5e24-94aa-abb81314b2a2
2026-03-28 12:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd1568d0>
2026-03-28 12:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3274a6e0-0b1a-5aba-a406-beb335beeeee/3274a6e0-0b1a-5aba-a406-beb335beeeee_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F6c%252Fb06c97d8b1deae9be098e8feb68c95cf%252Fpa%252FKV81214_6cd44bb293469f5a6d4a30626333ba1f.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_6cd44bb293469f5a6d4a30626333ba1f.jpg saved to cache
2026-03-28 12:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3274a6e0-0b1a-5aba-a406-beb335beeeee
2026-03-28 12:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_a40f63d240efad16b1bc89d1286e3973.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_31b1431ffb8a862102a7eb5a83f09bf7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LU93439/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_b63a53d189fd667fcb5d961f05231a64.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_5dbd09f70bbef93ea5c6e08197ab2cb1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_ac11ca91085f12aa5d3b3c6a46fafbaa.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_429aee183698da864cc54d72ef7c498a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_d778b0507335f41225fc2648063091db.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_cc019a1033e68571809600675ea4bef4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc6705d0>
2026-03-28 12:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fd24d2e-c7a4-5e24-94aa-abb81314b2a2/7fd24d2e-c7a4-5e24-94aa-abb81314b2a2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F4d%252F5c4dda21beac1477e02dd63c090b78c9%252Fpa%252FVU78996_a40f63d240efad16b1bc89d1286e3973.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_a40f63d240efad16b1bc89d1286e3973.jpg saved to cache
2026-03-28 12:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7fd24d2e-c7a4-5e24-94aa-abb81314b2a2
2026-03-28 12:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf14190>
2026-03-28 12:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3274a6e0-0b1a-5aba-a406-beb335beeeee/3274a6e0-0b1a-5aba-a406-beb335beeeee_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F6c%252Fb06c97d8b1deae9be098e8feb68c95cf%252Fpa%252FKV81214_31b1431ffb8a862102a7eb5a83f09bf7.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_31b1431ffb8a862102a7eb5a83f09bf7.jpg saved to cache
2026-03-28 12:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3274a6e0-0b1a-5aba-a406-beb335beeeee
2026-03-28 12:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GC10643/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_623a7fcde1de497936ddd0839bb3a99a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc39d190>
2026-03-28 12:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7db5a3-4d0d-5f29-a092-d00e71c3962e/1f7db5a3-4d0d-5f29-a092-d00e71c3962e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F9d%252F3b9d98fef86238b278f78ff9754d5ffa%252Fpa%252FLF71839_b63a53d189fd667fcb5d961f05231a64.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_b63a53d189fd667fcb5d961f05231a64.jpg saved to cache
2026-03-28 12:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f7db5a3-4d0d-5f29-a092-d00e71c3962e
2026-03-28 12:06:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f7db5a3-4d0d-5f29-a092-d00e71c3962e, skipping ID generation
2026-03-28 12:06:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f7db5a3-4d0d-5f29-a092-d00e71c3962e with scrape type 1
2026-03-28 12:06:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f7db5a3-4d0d-5f29-a092-d00e71c3962e sending to next pipeline
2026-03-28 12:06:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1f7db5a3-4d0d-5f29-a092-d00e71c3962e, identifier: LF71839
2026-03-28 12:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3ab6d0>
2026-03-28 12:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b60628-4f3c-5d4a-a89d-a2a00f9c5318/f6b60628-4f3c-5d4a-a89d-a2a00f9c5318_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F23%252Fae236281bbf1f5649f30d3cbb1017f93%252Fpa%252FRX99129_5dbd09f70bbef93ea5c6e08197ab2cb1.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_5dbd09f70bbef93ea5c6e08197ab2cb1.jpg saved to cache
2026-03-28 12:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f6b60628-4f3c-5d4a-a89d-a2a00f9c5318
2026-03-28 12:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcff3f90>
2026-03-28 12:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b60628-4f3c-5d4a-a89d-a2a00f9c5318/f6b60628-4f3c-5d4a-a89d-a2a00f9c5318_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F23%252Fae236281bbf1f5649f30d3cbb1017f93%252Fpa%252FRX99129_ac11ca91085f12aa5d3b3c6a46fafbaa.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_ac11ca91085f12aa5d3b3c6a46fafbaa.jpg saved to cache
2026-03-28 12:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f6b60628-4f3c-5d4a-a89d-a2a00f9c5318
2026-03-28 12:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc382910>
2026-03-28 12:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b60628-4f3c-5d4a-a89d-a2a00f9c5318/f6b60628-4f3c-5d4a-a89d-a2a00f9c5318_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F23%252Fae236281bbf1f5649f30d3cbb1017f93%252Fpa%252FRX99129_429aee183698da864cc54d72ef7c498a.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_429aee183698da864cc54d72ef7c498a.jpg saved to cache
2026-03-28 12:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f6b60628-4f3c-5d4a-a89d-a2a00f9c5318
2026-03-28 12:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd0143d0>
2026-03-28 12:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b60628-4f3c-5d4a-a89d-a2a00f9c5318/f6b60628-4f3c-5d4a-a89d-a2a00f9c5318_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F23%252Fae236281bbf1f5649f30d3cbb1017f93%252Fpa%252FRX99129_d778b0507335f41225fc2648063091db.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_d778b0507335f41225fc2648063091db.jpg saved to cache
2026-03-28 12:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f6b60628-4f3c-5d4a-a89d-a2a00f9c5318
2026-03-28 12:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcec9e90>
2026-03-28 12:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3274a6e0-0b1a-5aba-a406-beb335beeeee/3274a6e0-0b1a-5aba-a406-beb335beeeee_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F6c%252Fb06c97d8b1deae9be098e8feb68c95cf%252Fpa%252FKV81214_cc019a1033e68571809600675ea4bef4.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_cc019a1033e68571809600675ea4bef4.jpg saved to cache
2026-03-28 12:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3274a6e0-0b1a-5aba-a406-beb335beeeee
2026-03-28 12:06:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1f7db5a3-4d0d-5f29-a092-d00e71c3962e with identifier: LF71839
2026-03-28 12:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1f7db5a3-4d0d-5f29-a092-d00e71c3962e with identifier: LF71839
2026-03-28 12:06:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1f7db5a3-4d0d-5f29-a092-d00e71c3962e with identifier: LF71839 to the API
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_b63a53d189fd667fcb5d961f05231a64.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:29:05Z',
 'fuel_type': 'petrol',
 'id': '1f7db5a3-4d0d-5f29-a092-d00e71c3962e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF71839',
 'listing': 'auction',
 'location': 'IT, Segrate',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 120280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7db5a3-4d0d-5f29-a092-d00e71c3962e/1f7db5a3-4d0d-5f29-a092-d00e71c3962e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2571215,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_b63a53d189fd667fcb5d961f05231a64.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7db5a3-4d0d-5f29-a092-d00e71c3962e/1f7db5a3-4d0d-5f29-a092-d00e71c3962e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_8570d3539bf063139e237f008154e580.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7db5a3-4d0d-5f29-a092-d00e71c3962e/1f7db5a3-4d0d-5f29-a092-d00e71c3962e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_b3f61d7de082dbc7f99c5a20406e1ecd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7db5a3-4d0d-5f29-a092-d00e71c3962e/1f7db5a3-4d0d-5f29-a092-d00e71c3962e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_9f51835283c123b09e10ca09f726c946.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7db5a3-4d0d-5f29-a092-d00e71c3962e/1f7db5a3-4d0d-5f29-a092-d00e71c3962e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_da9cfb5df3648d210a030672e5feadf9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7db5a3-4d0d-5f29-a092-d00e71c3962e/1f7db5a3-4d0d-5f29-a092-d00e71c3962e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2599281,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_4b6d3ee2b797f5e063d3b14004efb2c6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7db5a3-4d0d-5f29-a092-d00e71c3962e/1f7db5a3-4d0d-5f29-a092-d00e71c3962e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2813277,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_4c937060fa8bd66ba856cadaf5815937.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7db5a3-4d0d-5f29-a092-d00e71c3962e/1f7db5a3-4d0d-5f29-a092-d00e71c3962e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2777236,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_2bac01db1361e3f1be885b7527421152.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7db5a3-4d0d-5f29-a092-d00e71c3962e/1f7db5a3-4d0d-5f29-a092-d00e71c3962e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2582941,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_0f982f8b746d675af827fc0c279a21be.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7db5a3-4d0d-5f29-a092-d00e71c3962e/1f7db5a3-4d0d-5f29-a092-d00e71c3962e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/9d/3b9d98fef86238b278f78ff9754d5ffa/pa/LF71839_92c27f2472451c12b11c313bf899577f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-03-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500C 1.2 Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2015}
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LF71839%27 HTTP/1.1" 200 None
2026-03-28 12:06:41 [auto1.it] INFO: Saving data for LF71839: {'created_time': 1774699601.608924, 'last_price_update_time': 1774699601.608933, 'auction_closing_time': 1774884545.0}
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LF71839') HTTP/1.1" 204 0
2026-03-28 12:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_ca954c71bcacaa94e45f77f11898a61a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CP63934/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZX02617/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EG76959> (referer: https://www.auto1.com/v1/car-details-view/EG76959/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:41 [auto1.it] INFO: Channel: 24h | Page: 6 | totalHits: 3674 | hits on page: 40
2026-03-28 12:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfeb850>
2026-03-28 12:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fd24d2e-c7a4-5e24-94aa-abb81314b2a2/7fd24d2e-c7a4-5e24-94aa-abb81314b2a2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F4d%252F5c4dda21beac1477e02dd63c090b78c9%252Fpa%252FVU78996_623a7fcde1de497936ddd0839bb3a99a.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_623a7fcde1de497936ddd0839bb3a99a.jpg saved to cache
2026-03-28 12:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7fd24d2e-c7a4-5e24-94aa-abb81314b2a2
2026-03-28 12:06:41 [auto1.it] INFO: Found listing with ID: EG76959
2026-03-28 12:06:41 [auto1.it] INFO: Found listing with ID: BV97003
2026-03-28 12:06:41 [auto1.it] INFO: Found listing with ID: EW38815
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW38815%27 HTTP/1.1" 200 None
2026-03-28 12:06:41 [auto1.it] INFO: Scrape type for EW38815: 1
2026-03-28 12:06:41 [auto1.it] INFO: Found listing with ID: RC51898
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC51898%27 HTTP/1.1" 200 None
2026-03-28 12:06:41 [auto1.it] INFO: Scrape type for RC51898: 0
2026-03-28 12:06:41 [auto1.it] INFO: Found listing with ID: RL93891
2026-03-28 12:06:41 [auto1.it] INFO: Found listing with ID: EX32240
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EX32240%27 HTTP/1.1" 200 None
2026-03-28 12:06:41 [auto1.it] INFO: Scrape type for EX32240: 1
2026-03-28 12:06:41 [auto1.it] INFO: Found listing with ID: SC52671
2026-03-28 12:06:41 [auto1.it] INFO: Found listing with ID: ZD86423
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD86423%27 HTTP/1.1" 200 None
2026-03-28 12:06:41 [auto1.it] INFO: Scrape type for ZD86423: 1
2026-03-28 12:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc509a90>
2026-03-28 12:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3274a6e0-0b1a-5aba-a406-beb335beeeee/3274a6e0-0b1a-5aba-a406-beb335beeeee_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F6c%252Fb06c97d8b1deae9be098e8feb68c95cf%252Fpa%252FKV81214_ca954c71bcacaa94e45f77f11898a61a.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_ca954c71bcacaa94e45f77f11898a61a.jpg saved to cache
2026-03-28 12:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3274a6e0-0b1a-5aba-a406-beb335beeeee
2026-03-28 12:06:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 414ee5a8-9966-5155-a7ea-6743de9d969e with identifier: EG76959
2026-03-28 12:06:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 414ee5a8-9966-5155-a7ea-6743de9d969e with scrape type 1
2026-03-28 12:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 414ee5a8-9966-5155-a7ea-6743de9d969e
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F4f%252Fb04fe85e59a6f1572dcd7cea19f81faa%252Fpa%252FEG76959_aa2ec67f8dd6c63dc0ee59953539fb7d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_aa2ec67f8dd6c63dc0ee59953539fb7d.jpg not downloaded yet
2026-03-28 12:06:41 [auto1.it] INFO: Found listing with ID: FJ00600
2026-03-28 12:06:41 [auto1.it] INFO: Found listing with ID: GD51545
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD51545%27 HTTP/1.1" 200 None
2026-03-28 12:06:41 [auto1.it] INFO: Scrape type for GD51545: 1
2026-03-28 12:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_2437d584f6843094b7db146ffc3c188c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F4f%252Fb04fe85e59a6f1572dcd7cea19f81faa%252Fpa%252FEG76959_39a5030bd78d94ce8c319e0b3748d2ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_39a5030bd78d94ce8c319e0b3748d2ae.jpg not downloaded yet
2026-03-28 12:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_61c1b42fe8a7ce81d5c56b22f7b9e0ed.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_d80e9d2f13ee6986aa90e5c9b3aad1d2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:41 [auto1.it] INFO: Found listing with ID: HC77212
2026-03-28 12:06:41 [auto1.it] INFO: Found listing with ID: UD61440
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD61440%27 HTTP/1.1" 200 None
2026-03-28 12:06:41 [auto1.it] INFO: Scrape type for UD61440: 1
2026-03-28 12:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LU04143/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F4f%252Fb04fe85e59a6f1572dcd7cea19f81faa%252Fpa%252FEG76959_0199f5977fce220b8cca06dfdf27ec87.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_0199f5977fce220b8cca06dfdf27ec87.jpg not downloaded yet
2026-03-28 12:06:41 [auto1.it] INFO: Found listing with ID: EP46313
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP46313%27 HTTP/1.1" 200 None
2026-03-28 12:06:41 [auto1.it] INFO: Scrape type for EP46313: 2
2026-03-28 12:06:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 271d4042-2b7b-5c1c-a9b4-f94a4651c34b with identifier: EP46313
2026-03-28 12:06:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 271d4042-2b7b-5c1c-a9b4-f94a4651c34b with scrape type 2
2026-03-28 12:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 271d4042-2b7b-5c1c-a9b4-f94a4651c34b with scrape type 2
2026-03-28 12:06:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 271d4042-2b7b-5c1c-a9b4-f94a4651c34b, identifier: EP46313
2026-03-28 12:06:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 271d4042-2b7b-5c1c-a9b4-f94a4651c34b with identifier: EP46313
2026-03-28 12:06:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 271d4042-2b7b-5c1c-a9b4-f94a4651c34b with identifier: EP46313
2026-03-28 12:06:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 271d4042-2b7b-5c1c-a9b4-f94a4651c34b with identifier: EP46313 to the API
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-30T15:19:49Z',
 'fuel_type': 'diesel',
 'id': '271d4042-2b7b-5c1c-a9b4-f94a4651c34b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP46313',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 234255,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-24',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 B4 Mild-Hybrid Core 2WD',
 'transmission': 'automatic',
 'trim': 'Core 2WD',
 'year': 2022}
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP46313%27 HTTP/1.1" 200 None
2026-03-28 12:06:42 [auto1.it] INFO: Saving data for EP46313: {'auction_closing_time': 1774883989.0, 'created_time': 1774343191.116189, 'last_price_update_time': 1774699602.378937}
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EP46313') HTTP/1.1" 204 0
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F4f%252Fb04fe85e59a6f1572dcd7cea19f81faa%252Fpa%252FEG76959_d6485a9799682b978ec21e41bea7f32f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_d6485a9799682b978ec21e41bea7f32f.jpg not downloaded yet
2026-03-28 12:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_2b0e97886732499b7ce4088c82a0e5e2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_1d3254cf69cf95a1dce478b20f706fd5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:42 [auto1.it] INFO: Found listing with ID: NB70789
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB70789%27 HTTP/1.1" 200 None
2026-03-28 12:06:42 [auto1.it] INFO: Scrape type for NB70789: 1
2026-03-28 12:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_8b6ff080d5295c06d3e931d4aadd280d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F4f%252Fb04fe85e59a6f1572dcd7cea19f81faa%252Fpa%252FEG76959_817fc916388915d1bfa8dd13301013a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_817fc916388915d1bfa8dd13301013a4.jpg not downloaded yet
2026-03-28 12:06:42 [auto1.it] INFO: Found listing with ID: ZF56836
2026-03-28 12:06:42 [auto1.it] INFO: Found listing with ID: LS68308
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS68308%27 HTTP/1.1" 200 None
2026-03-28 12:06:42 [auto1.it] INFO: Scrape type for LS68308: 1
2026-03-28 12:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PK33610> (referer: https://www.auto1.com/v1/car-details-view/PK33610/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcea0f90>
2026-03-28 12:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fd24d2e-c7a4-5e24-94aa-abb81314b2a2/7fd24d2e-c7a4-5e24-94aa-abb81314b2a2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F4d%252F5c4dda21beac1477e02dd63c090b78c9%252Fpa%252FVU78996_2437d584f6843094b7db146ffc3c188c.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_2437d584f6843094b7db146ffc3c188c.jpg saved to cache
2026-03-28 12:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7fd24d2e-c7a4-5e24-94aa-abb81314b2a2
2026-03-28 12:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcebca50>
2026-03-28 12:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_226ea16f-8e4c-5c8c-8029-e732542d307f/226ea16f-8e4c-5c8c-8029-e732542d307f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F38%252F40380e14f263dd4a58844d0c434613aa%252Fpa%252FPR73005_61c1b42fe8a7ce81d5c56b22f7b9e0ed.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_61c1b42fe8a7ce81d5c56b22f7b9e0ed.jpg saved to cache
2026-03-28 12:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 226ea16f-8e4c-5c8c-8029-e732542d307f
2026-03-28 12:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf23250>
2026-03-28 12:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3274a6e0-0b1a-5aba-a406-beb335beeeee/3274a6e0-0b1a-5aba-a406-beb335beeeee_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F6c%252Fb06c97d8b1deae9be098e8feb68c95cf%252Fpa%252FKV81214_d80e9d2f13ee6986aa90e5c9b3aad1d2.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_d80e9d2f13ee6986aa90e5c9b3aad1d2.jpg saved to cache
2026-03-28 12:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3274a6e0-0b1a-5aba-a406-beb335beeeee
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F4f%252Fb04fe85e59a6f1572dcd7cea19f81faa%252Fpa%252FEG76959_98f58116cf173e14e720d5d22664ca22.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_98f58116cf173e14e720d5d22664ca22.jpg not downloaded yet
2026-03-28 12:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_6d2c960c88e7b008e34ec61e3ba78c2e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_aa2ec67f8dd6c63dc0ee59953539fb7d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:42 [auto1.it] INFO: Found listing with ID: LX14349
2026-03-28 12:06:42 [auto1.it] INFO: Found listing with ID: HU17700
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU17700%27 HTTP/1.1" 200 None
2026-03-28 12:06:42 [auto1.it] INFO: Scrape type for HU17700: 2
2026-03-28 12:06:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfc9795f-bc6f-5e47-ac08-3e603016d0d1 with identifier: HU17700
2026-03-28 12:06:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfc9795f-bc6f-5e47-ac08-3e603016d0d1 with scrape type 2
2026-03-28 12:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfc9795f-bc6f-5e47-ac08-3e603016d0d1 with scrape type 2
2026-03-28 12:06:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bfc9795f-bc6f-5e47-ac08-3e603016d0d1, identifier: HU17700
2026-03-28 12:06:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcebcfd0>
2026-03-28 12:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_226ea16f-8e4c-5c8c-8029-e732542d307f/226ea16f-8e4c-5c8c-8029-e732542d307f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F38%252F40380e14f263dd4a58844d0c434613aa%252Fpa%252FPR73005_2b0e97886732499b7ce4088c82a0e5e2.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_2b0e97886732499b7ce4088c82a0e5e2.jpg saved to cache
2026-03-28 12:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 226ea16f-8e4c-5c8c-8029-e732542d307f
2026-03-28 12:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bce7d090>
2026-03-28 12:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3274a6e0-0b1a-5aba-a406-beb335beeeee/3274a6e0-0b1a-5aba-a406-beb335beeeee_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F6c%252Fb06c97d8b1deae9be098e8feb68c95cf%252Fpa%252FKV81214_1d3254cf69cf95a1dce478b20f706fd5.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_1d3254cf69cf95a1dce478b20f706fd5.jpg saved to cache
2026-03-28 12:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3274a6e0-0b1a-5aba-a406-beb335beeeee
2026-03-28 12:06:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bfc9795f-bc6f-5e47-ac08-3e603016d0d1 with identifier: HU17700
2026-03-28 12:06:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bfc9795f-bc6f-5e47-ac08-3e603016d0d1 with identifier: HU17700
2026-03-28 12:06:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bfc9795f-bc6f-5e47-ac08-3e603016d0d1 with identifier: HU17700 to the API
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:58:05Z',
 'fuel_type': 'petrol',
 'id': 'bfc9795f-bc6f-5e47-ac08-3e603016d0d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU17700',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 131664,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-02',
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU17700%27 HTTP/1.1" 200 None
2026-03-28 12:06:43 [auto1.it] INFO: Saving data for HU17700: {'auction_closing_time': 1774886285.0, 'created_time': 1773136444.065713, 'last_price_update_time': 1774699603.334807}
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HU17700') HTTP/1.1" 204 0
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F4f%252Fb04fe85e59a6f1572dcd7cea19f81faa%252Fpa%252FEG76959_fa2c56790909f2d1c2bbd3c3679dc73b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_fa2c56790909f2d1c2bbd3c3679dc73b.jpg not downloaded yet
2026-03-28 12:06:43 [auto1.it] INFO: Found listing with ID: XB86450
2026-03-28 12:06:43 [auto1.it] INFO: Found listing with ID: BC13106
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BC13106%27 HTTP/1.1" 200 None
2026-03-28 12:06:43 [auto1.it] INFO: Scrape type for BC13106: 1
2026-03-28 12:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_0199f5977fce220b8cca06dfdf27ec87.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F4f%252Fb04fe85e59a6f1572dcd7cea19f81faa%252Fpa%252FEG76959_f9bf9f7e01c5cc4080c248ee34d30557.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_f9bf9f7e01c5cc4080c248ee34d30557.jpg not downloaded yet
2026-03-28 12:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfbd950>
2026-03-28 12:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_226ea16f-8e4c-5c8c-8029-e732542d307f/226ea16f-8e4c-5c8c-8029-e732542d307f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F38%252F40380e14f263dd4a58844d0c434613aa%252Fpa%252FPR73005_8b6ff080d5295c06d3e931d4aadd280d.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_8b6ff080d5295c06d3e931d4aadd280d.jpg saved to cache
2026-03-28 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 226ea16f-8e4c-5c8c-8029-e732542d307f
2026-03-28 12:06:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3652c92f-d6ed-5635-a482-c31d8f9fc39d with identifier: PK33610
2026-03-28 12:06:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3652c92f-d6ed-5635-a482-c31d8f9fc39d with scrape type 1
2026-03-28 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3652c92f-d6ed-5635-a482-c31d8f9fc39d
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fdd%252F71ddf47d2f6b29b49fdb4501aab760e2%252Fpa%252FPK33610_69833282e5d36efb960808b5964e8ebe.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_69833282e5d36efb960808b5964e8ebe.jpg not downloaded yet
2026-03-28 12:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf30110>
2026-03-28 12:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fd24d2e-c7a4-5e24-94aa-abb81314b2a2/7fd24d2e-c7a4-5e24-94aa-abb81314b2a2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F4d%252F5c4dda21beac1477e02dd63c090b78c9%252Fpa%252FVU78996_6d2c960c88e7b008e34ec61e3ba78c2e.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_6d2c960c88e7b008e34ec61e3ba78c2e.jpg saved to cache
2026-03-28 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7fd24d2e-c7a4-5e24-94aa-abb81314b2a2
2026-03-28 12:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc401cd0>
2026-03-28 12:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414ee5a8-9966-5155-a7ea-6743de9d969e/414ee5a8-9966-5155-a7ea-6743de9d969e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F4f%252Fb04fe85e59a6f1572dcd7cea19f81faa%252Fpa%252FEG76959_aa2ec67f8dd6c63dc0ee59953539fb7d.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_aa2ec67f8dd6c63dc0ee59953539fb7d.jpg saved to cache
2026-03-28 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 414ee5a8-9966-5155-a7ea-6743de9d969e
2026-03-28 12:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_39a5030bd78d94ce8c319e0b3748d2ae.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:43 [auto1.it] INFO: Found listing with ID: SS75136
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS75136%27 HTTP/1.1" 200 None
2026-03-28 12:06:43 [auto1.it] INFO: Scrape type for SS75136: 1
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F4f%252Fb04fe85e59a6f1572dcd7cea19f81faa%252Fpa%252FEG76959_e9bcbf2befff65ec598b3be77179e673.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_e9bcbf2befff65ec598b3be77179e673.jpg not downloaded yet
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fdd%252F71ddf47d2f6b29b49fdb4501aab760e2%252Fpa%252FPK33610_3c48f6c3297c30a11e10fd2f09bb8499.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_3c48f6c3297c30a11e10fd2f09bb8499.jpg not downloaded yet
2026-03-28 12:06:43 [auto1.it] INFO: Found listing with ID: TZ08821
2026-03-28 12:06:43 [auto1.it] INFO: Found listing with ID: FW12151
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FW12151%27 HTTP/1.1" 200 None
2026-03-28 12:06:43 [auto1.it] INFO: Scrape type for FW12151: 1
2026-03-28 12:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd032ad0>
2026-03-28 12:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414ee5a8-9966-5155-a7ea-6743de9d969e/414ee5a8-9966-5155-a7ea-6743de9d969e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F4f%252Fb04fe85e59a6f1572dcd7cea19f81faa%252Fpa%252FEG76959_0199f5977fce220b8cca06dfdf27ec87.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_0199f5977fce220b8cca06dfdf27ec87.jpg saved to cache
2026-03-28 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 414ee5a8-9966-5155-a7ea-6743de9d969e
2026-03-28 12:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_817fc916388915d1bfa8dd13301013a4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F4f%252Fb04fe85e59a6f1572dcd7cea19f81faa%252Fpa%252FEG76959_dd03df6481c1310e49e4f5bb51871385.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_dd03df6481c1310e49e4f5bb51871385.jpg not downloaded yet
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fdd%252F71ddf47d2f6b29b49fdb4501aab760e2%252Fpa%252FPK33610_0bd7310beaf2ff95d339a4619249b827.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_0bd7310beaf2ff95d339a4619249b827.jpg not downloaded yet
2026-03-28 12:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_6a6ebbe996f1c609ad122ad09b1ab209.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:43 [auto1.it] INFO: Found listing with ID: SD66994
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD66994%27 HTTP/1.1" 200 None
2026-03-28 12:06:43 [auto1.it] INFO: Scrape type for SD66994: 1
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fdd%252F71ddf47d2f6b29b49fdb4501aab760e2%252Fpa%252FPK33610_a21e10280aabaaba4484f3a798107a6b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_a21e10280aabaaba4484f3a798107a6b.jpg not downloaded yet
2026-03-28 12:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf06390>
2026-03-28 12:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414ee5a8-9966-5155-a7ea-6743de9d969e/414ee5a8-9966-5155-a7ea-6743de9d969e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F4f%252Fb04fe85e59a6f1572dcd7cea19f81faa%252Fpa%252FEG76959_39a5030bd78d94ce8c319e0b3748d2ae.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_39a5030bd78d94ce8c319e0b3748d2ae.jpg saved to cache
2026-03-28 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 414ee5a8-9966-5155-a7ea-6743de9d969e
2026-03-28 12:06:43 [auto1.it] INFO: Found listing with ID: LB50046
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB50046%27 HTTP/1.1" 200 None
2026-03-28 12:06:43 [auto1.it] INFO: Scrape type for LB50046: 1
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fdd%252F71ddf47d2f6b29b49fdb4501aab760e2%252Fpa%252FPK33610_5a013466b2cc6e10b9d98dce6f70673e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_5a013466b2cc6e10b9d98dce6f70673e.jpg not downloaded yet
2026-03-28 12:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_fa2c56790909f2d1c2bbd3c3679dc73b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:43 [auto1.it] INFO: Found listing with ID: NL74097
2026-03-28 12:06:43 [auto1.it] INFO: Found listing with ID: ME27860
2026-03-28 12:06:43 [auto1.it] INFO: Found listing with ID: MX93098
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX93098%27 HTTP/1.1" 200 None
2026-03-28 12:06:43 [auto1.it] INFO: Scrape type for MX93098: 1
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fdd%252F71ddf47d2f6b29b49fdb4501aab760e2%252Fpa%252FPK33610_233d28178b1ec672dd965ad339c6611d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_233d28178b1ec672dd965ad339c6611d.jpg not downloaded yet
2026-03-28 12:06:43 [auto1.it] INFO: Found listing with ID: CL75380
2026-03-28 12:06:43 [auto1.it] INFO: Found listing with ID: VK29965
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK29965%27 HTTP/1.1" 200 None
2026-03-28 12:06:43 [auto1.it] INFO: Scrape type for VK29965: 1
2026-03-28 12:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc544690>
2026-03-28 12:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414ee5a8-9966-5155-a7ea-6743de9d969e/414ee5a8-9966-5155-a7ea-6743de9d969e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F4f%252Fb04fe85e59a6f1572dcd7cea19f81faa%252Fpa%252FEG76959_817fc916388915d1bfa8dd13301013a4.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_817fc916388915d1bfa8dd13301013a4.jpg saved to cache
2026-03-28 12:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 414ee5a8-9966-5155-a7ea-6743de9d969e
2026-03-28 12:06:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3eaf50>
2026-03-28 12:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_226ea16f-8e4c-5c8c-8029-e732542d307f/226ea16f-8e4c-5c8c-8029-e732542d307f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F38%252F40380e14f263dd4a58844d0c434613aa%252Fpa%252FPR73005_6a6ebbe996f1c609ad122ad09b1ab209.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_6a6ebbe996f1c609ad122ad09b1ab209.jpg saved to cache
2026-03-28 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 226ea16f-8e4c-5c8c-8029-e732542d307f
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fdd%252F71ddf47d2f6b29b49fdb4501aab760e2%252Fpa%252FPK33610_c4c1c07fcef296d9242604651dcf5805.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_c4c1c07fcef296d9242604651dcf5805.jpg not downloaded yet
2026-03-28 12:06:44 [auto1.it] INFO: Found listing with ID: WG00273
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG00273%27 HTTP/1.1" 200 None
2026-03-28 12:06:44 [auto1.it] INFO: Scrape type for WG00273: 1
2026-03-28 12:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_3c48f6c3297c30a11e10fd2f09bb8499.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fdd%252F71ddf47d2f6b29b49fdb4501aab760e2%252Fpa%252FPK33610_3103932431cc3ee03c0374d6d58d1ff0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_3103932431cc3ee03c0374d6d58d1ff0.jpg not downloaded yet
2026-03-28 12:06:44 [auto1.it] INFO: Found listing with ID: BX84836
2026-03-28 12:06:44 [auto1.it] INFO: Found listing with ID: ZH45027
2026-03-28 12:06:44 [auto1.it] INFO: Found listing with ID: CD24058
2026-03-28 12:06:44 [auto1.it] INFO: Found listing with ID: VB56015
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB56015%27 HTTP/1.1" 200 None
2026-03-28 12:06:44 [auto1.it] INFO: Scrape type for VB56015: 1
2026-03-28 12:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc4f4e10>
2026-03-28 12:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414ee5a8-9966-5155-a7ea-6743de9d969e/414ee5a8-9966-5155-a7ea-6743de9d969e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F4f%252Fb04fe85e59a6f1572dcd7cea19f81faa%252Fpa%252FEG76959_fa2c56790909f2d1c2bbd3c3679dc73b.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_fa2c56790909f2d1c2bbd3c3679dc73b.jpg saved to cache
2026-03-28 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 414ee5a8-9966-5155-a7ea-6743de9d969e
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fdd%252F71ddf47d2f6b29b49fdb4501aab760e2%252Fpa%252FPK33610_7eeedb87ac33c0a890cdb7ef8551dc7a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_7eeedb87ac33c0a890cdb7ef8551dc7a.jpg not downloaded yet
2026-03-28 12:06:44 [auto1.it] INFO: Found listing with ID: TV81460
2026-03-28 12:06:44 [auto1.it] INFO: Found listing with ID: RK78436
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK78436%27 HTTP/1.1" 200 None
2026-03-28 12:06:44 [auto1.it] INFO: Scrape type for RK78436: 1
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fdd%252F71ddf47d2f6b29b49fdb4501aab760e2%252Fpa%252FPK33610_c94c834bd52ca25bfcb9801113b2bae9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_c94c834bd52ca25bfcb9801113b2bae9.jpg not downloaded yet
2026-03-28 12:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZX02617> (referer: https://www.auto1.com/v1/car-details-view/ZX02617/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:44 [auto1.it] INFO: Found listing with ID: SX60727
2026-03-28 12:06:44 [auto1.it] INFO: Found listing with ID: SF25356
2026-03-28 12:06:44 [auto1.it] INFO: Found listing with ID: PB64949
2026-03-28 12:06:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UD61440/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_13b61f9190063883faf5719181c051cc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf78b90>
2026-03-28 12:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fdd%252F71ddf47d2f6b29b49fdb4501aab760e2%252Fpa%252FPK33610_3c48f6c3297c30a11e10fd2f09bb8499.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_3c48f6c3297c30a11e10fd2f09bb8499.jpg saved to cache
2026-03-28 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3652c92f-d6ed-5635-a482-c31d8f9fc39d
2026-03-28 12:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_a1f20cb3f14562e0d9858db7c7712696.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GD51545/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_300d63709fb34ebc1c929aecf3ee6b4e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_55c490e4d646390b31c58a5c93486ba6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 879e56cb-6dfd-584f-b307-a60aa53227cc with identifier: ZX02617
2026-03-28 12:06:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 879e56cb-6dfd-584f-b307-a60aa53227cc with scrape type 1
2026-03-28 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 879e56cb-6dfd-584f-b307-a60aa53227cc
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F3e%252F153ee8bb06b005df8e199eafa507c95d%252Fpa%252FZX02617_2b4ef9c4a52b0aa40b1ae0d3ba978729.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_2b4ef9c4a52b0aa40b1ae0d3ba978729.jpg not downloaded yet
2026-03-28 12:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_c4c1c07fcef296d9242604651dcf5805.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F3e%252F153ee8bb06b005df8e199eafa507c95d%252Fpa%252FZX02617_b9ed71b9ae047a96ac15ea8bd695f85b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_b9ed71b9ae047a96ac15ea8bd695f85b.jpg not downloaded yet
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F3e%252F153ee8bb06b005df8e199eafa507c95d%252Fpa%252FZX02617_223b9d6602476e80d69fb80d5cc90ef5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_223b9d6602476e80d69fb80d5cc90ef5.jpg not downloaded yet
2026-03-28 12:06:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5bccd0>
2026-03-28 12:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3274a6e0-0b1a-5aba-a406-beb335beeeee/3274a6e0-0b1a-5aba-a406-beb335beeeee_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F6c%252Fb06c97d8b1deae9be098e8feb68c95cf%252Fpa%252FKV81214_13b61f9190063883faf5719181c051cc.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_13b61f9190063883faf5719181c051cc.jpg saved to cache
2026-03-28 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3274a6e0-0b1a-5aba-a406-beb335beeeee
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F3e%252F153ee8bb06b005df8e199eafa507c95d%252Fpa%252FZX02617_219d597003920f98cd7d74cc04c40605.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_219d597003920f98cd7d74cc04c40605.jpg not downloaded yet
2026-03-28 12:06:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3c4390>
2026-03-28 12:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_226ea16f-8e4c-5c8c-8029-e732542d307f/226ea16f-8e4c-5c8c-8029-e732542d307f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F38%252F40380e14f263dd4a58844d0c434613aa%252Fpa%252FPR73005_a1f20cb3f14562e0d9858db7c7712696.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_a1f20cb3f14562e0d9858db7c7712696.jpg saved to cache
2026-03-28 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 226ea16f-8e4c-5c8c-8029-e732542d307f
2026-03-28 12:06:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcefc2d0>
2026-03-28 12:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fd24d2e-c7a4-5e24-94aa-abb81314b2a2/7fd24d2e-c7a4-5e24-94aa-abb81314b2a2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F4d%252F5c4dda21beac1477e02dd63c090b78c9%252Fpa%252FVU78996_300d63709fb34ebc1c929aecf3ee6b4e.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_300d63709fb34ebc1c929aecf3ee6b4e.jpg saved to cache
2026-03-28 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7fd24d2e-c7a4-5e24-94aa-abb81314b2a2
2026-03-28 12:06:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3cc890>
2026-03-28 12:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fd24d2e-c7a4-5e24-94aa-abb81314b2a2/7fd24d2e-c7a4-5e24-94aa-abb81314b2a2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F4d%252F5c4dda21beac1477e02dd63c090b78c9%252Fpa%252FVU78996_55c490e4d646390b31c58a5c93486ba6.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_55c490e4d646390b31c58a5c93486ba6.jpg saved to cache
2026-03-28 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7fd24d2e-c7a4-5e24-94aa-abb81314b2a2
2026-03-28 12:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_7eeedb87ac33c0a890cdb7ef8551dc7a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_3103932431cc3ee03c0374d6d58d1ff0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F3e%252F153ee8bb06b005df8e199eafa507c95d%252Fpa%252FZX02617_4a1a75c8890480e0a2499a8efcc5182a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_4a1a75c8890480e0a2499a8efcc5182a.jpg not downloaded yet
2026-03-28 12:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NB70789/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F3e%252F153ee8bb06b005df8e199eafa507c95d%252Fpa%252FZX02617_5479cdfcc82fc8b22a6ea9a4cbb0199d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_5479cdfcc82fc8b22a6ea9a4cbb0199d.jpg not downloaded yet
2026-03-28 12:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LS68308/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LU04143> (referer: https://www.auto1.com/v1/car-details-view/LU04143/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3d8a10>
2026-03-28 12:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fdd%252F71ddf47d2f6b29b49fdb4501aab760e2%252Fpa%252FPK33610_c4c1c07fcef296d9242604651dcf5805.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_c4c1c07fcef296d9242604651dcf5805.jpg saved to cache
2026-03-28 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3652c92f-d6ed-5635-a482-c31d8f9fc39d
2026-03-28 12:06:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F3e%252F153ee8bb06b005df8e199eafa507c95d%252Fpa%252FZX02617_2ba2bc31dceac7e13eb54cd28211475d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_2ba2bc31dceac7e13eb54cd28211475d.jpg not downloaded yet
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F3e%252F153ee8bb06b005df8e199eafa507c95d%252Fpa%252FZX02617_787e563be0507c190b87cbb80e17983a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_787e563be0507c190b87cbb80e17983a.jpg not downloaded yet
2026-03-28 12:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5842d0>
2026-03-28 12:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fdd%252F71ddf47d2f6b29b49fdb4501aab760e2%252Fpa%252FPK33610_7eeedb87ac33c0a890cdb7ef8551dc7a.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_7eeedb87ac33c0a890cdb7ef8551dc7a.jpg saved to cache
2026-03-28 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3652c92f-d6ed-5635-a482-c31d8f9fc39d
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcefdf90>
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fdd%252F71ddf47d2f6b29b49fdb4501aab760e2%252Fpa%252FPK33610_3103932431cc3ee03c0374d6d58d1ff0.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_3103932431cc3ee03c0374d6d58d1ff0.jpg saved to cache
2026-03-28 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3652c92f-d6ed-5635-a482-c31d8f9fc39d
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F3e%252F153ee8bb06b005df8e199eafa507c95d%252Fpa%252FZX02617_e091bfd6fff1d53aea139d2924bafcc5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_e091bfd6fff1d53aea139d2924bafcc5.jpg not downloaded yet
2026-03-28 12:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_2b4ef9c4a52b0aa40b1ae0d3ba978729.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F3e%252F153ee8bb06b005df8e199eafa507c95d%252Fpa%252FZX02617_108f33bca457f4f851776ae8d81c4968.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_108f33bca457f4f851776ae8d81c4968.jpg not downloaded yet
2026-03-28 12:06:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05f82b77-8d52-52f3-a982-0584a35cf205 with identifier: LU04143
2026-03-28 12:06:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05f82b77-8d52-52f3-a982-0584a35cf205 with scrape type 1
2026-03-28 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 05f82b77-8d52-52f3-a982-0584a35cf205
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe4%252F98e4406fee40735271344bce32758766%252Fpa%252FLU04143_4c05bc0936b362e3bc4e096ff7233da3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_4c05bc0936b362e3bc4e096ff7233da3.jpg not downloaded yet
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe4%252F98e4406fee40735271344bce32758766%252Fpa%252FLU04143_358c8690b8b92cf634ca82268432d992.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_358c8690b8b92cf634ca82268432d992.jpg not downloaded yet
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe4%252F98e4406fee40735271344bce32758766%252Fpa%252FLU04143_244f8280d9072f6ae4f1ead0b09a49a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_244f8280d9072f6ae4f1ead0b09a49a0.jpg not downloaded yet
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe4%252F98e4406fee40735271344bce32758766%252Fpa%252FLU04143_69556f78078d946bdde73d6b64a4da3a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_69556f78078d946bdde73d6b64a4da3a.jpg not downloaded yet
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe4%252F98e4406fee40735271344bce32758766%252Fpa%252FLU04143_fdb8bd0a8267fde16ff781ec3116b01d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_fdb8bd0a8267fde16ff781ec3116b01d.jpg not downloaded yet
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe4%252F98e4406fee40735271344bce32758766%252Fpa%252FLU04143_6f015a0917dfb4929c301fcb790eb0f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_6f015a0917dfb4929c301fcb790eb0f1.jpg not downloaded yet
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe4%252F98e4406fee40735271344bce32758766%252Fpa%252FLU04143_23e7ed396d44d9d22f70651961d80bf9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_23e7ed396d44d9d22f70651961d80bf9.jpg not downloaded yet
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc573dd0>
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_879e56cb-6dfd-584f-b307-a60aa53227cc/879e56cb-6dfd-584f-b307-a60aa53227cc_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F3e%252F153ee8bb06b005df8e199eafa507c95d%252Fpa%252FZX02617_2b4ef9c4a52b0aa40b1ae0d3ba978729.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_2b4ef9c4a52b0aa40b1ae0d3ba978729.jpg saved to cache
2026-03-28 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 879e56cb-6dfd-584f-b307-a60aa53227cc
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe4%252F98e4406fee40735271344bce32758766%252Fpa%252FLU04143_49a521643aa5b3fa5becfd63209a9a01.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_49a521643aa5b3fa5becfd63209a9a01.jpg not downloaded yet
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe4%252F98e4406fee40735271344bce32758766%252Fpa%252FLU04143_8304542e0fd5f20e5e0217d85eeb5e25.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_8304542e0fd5f20e5e0217d85eeb5e25.jpg not downloaded yet
2026-03-28 12:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_c94c834bd52ca25bfcb9801113b2bae9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_e091bfd6fff1d53aea139d2924bafcc5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe4%252F98e4406fee40735271344bce32758766%252Fpa%252FLU04143_1ac8b591d3fa39100f3201bf07890ba7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_1ac8b591d3fa39100f3201bf07890ba7.jpg not downloaded yet
2026-03-28 12:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FW12151/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_219d597003920f98cd7d74cc04c40605.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_4a1a75c8890480e0a2499a8efcc5182a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_223b9d6602476e80d69fb80d5cc90ef5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_b9ed71b9ae047a96ac15ea8bd695f85b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf32b50>
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fdd%252F71ddf47d2f6b29b49fdb4501aab760e2%252Fpa%252FPK33610_c94c834bd52ca25bfcb9801113b2bae9.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_c94c834bd52ca25bfcb9801113b2bae9.jpg saved to cache
2026-03-28 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3652c92f-d6ed-5635-a482-c31d8f9fc39d
2026-03-28 12:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_23e7ed396d44d9d22f70651961d80bf9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bce81e10>
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_879e56cb-6dfd-584f-b307-a60aa53227cc/879e56cb-6dfd-584f-b307-a60aa53227cc_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F3e%252F153ee8bb06b005df8e199eafa507c95d%252Fpa%252FZX02617_e091bfd6fff1d53aea139d2924bafcc5.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_e091bfd6fff1d53aea139d2924bafcc5.jpg saved to cache
2026-03-28 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 879e56cb-6dfd-584f-b307-a60aa53227cc
2026-03-28 12:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_8304542e0fd5f20e5e0217d85eeb5e25.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_49a521643aa5b3fa5becfd63209a9a01.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BC13106/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc544090>
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_879e56cb-6dfd-584f-b307-a60aa53227cc/879e56cb-6dfd-584f-b307-a60aa53227cc_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F3e%252F153ee8bb06b005df8e199eafa507c95d%252Fpa%252FZX02617_219d597003920f98cd7d74cc04c40605.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_219d597003920f98cd7d74cc04c40605.jpg saved to cache
2026-03-28 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 879e56cb-6dfd-584f-b307-a60aa53227cc
2026-03-28 12:06:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf653d0>
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_879e56cb-6dfd-584f-b307-a60aa53227cc/879e56cb-6dfd-584f-b307-a60aa53227cc_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F3e%252F153ee8bb06b005df8e199eafa507c95d%252Fpa%252FZX02617_4a1a75c8890480e0a2499a8efcc5182a.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_4a1a75c8890480e0a2499a8efcc5182a.jpg saved to cache
2026-03-28 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 879e56cb-6dfd-584f-b307-a60aa53227cc
2026-03-28 12:06:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bce98410>
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_879e56cb-6dfd-584f-b307-a60aa53227cc/879e56cb-6dfd-584f-b307-a60aa53227cc_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F3e%252F153ee8bb06b005df8e199eafa507c95d%252Fpa%252FZX02617_223b9d6602476e80d69fb80d5cc90ef5.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_223b9d6602476e80d69fb80d5cc90ef5.jpg saved to cache
2026-03-28 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 879e56cb-6dfd-584f-b307-a60aa53227cc
2026-03-28 12:06:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf67010>
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_879e56cb-6dfd-584f-b307-a60aa53227cc/879e56cb-6dfd-584f-b307-a60aa53227cc_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F3e%252F153ee8bb06b005df8e199eafa507c95d%252Fpa%252FZX02617_b9ed71b9ae047a96ac15ea8bd695f85b.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_b9ed71b9ae047a96ac15ea8bd695f85b.jpg saved to cache
2026-03-28 12:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 879e56cb-6dfd-584f-b307-a60aa53227cc
2026-03-28 12:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LB50046/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RK78436/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfdb7d0>
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05f82b77-8d52-52f3-a982-0584a35cf205/05f82b77-8d52-52f3-a982-0584a35cf205_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe4%252F98e4406fee40735271344bce32758766%252Fpa%252FLU04143_23e7ed396d44d9d22f70651961d80bf9.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_23e7ed396d44d9d22f70651961d80bf9.jpg saved to cache
2026-03-28 12:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 05f82b77-8d52-52f3-a982-0584a35cf205
2026-03-28 12:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfd4110>
2026-03-28 12:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05f82b77-8d52-52f3-a982-0584a35cf205/05f82b77-8d52-52f3-a982-0584a35cf205_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe4%252F98e4406fee40735271344bce32758766%252Fpa%252FLU04143_8304542e0fd5f20e5e0217d85eeb5e25.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_8304542e0fd5f20e5e0217d85eeb5e25.jpg saved to cache
2026-03-28 12:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 05f82b77-8d52-52f3-a982-0584a35cf205
2026-03-28 12:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc54ee90>
2026-03-28 12:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05f82b77-8d52-52f3-a982-0584a35cf205/05f82b77-8d52-52f3-a982-0584a35cf205_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe4%252F98e4406fee40735271344bce32758766%252Fpa%252FLU04143_49a521643aa5b3fa5becfd63209a9a01.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_49a521643aa5b3fa5becfd63209a9a01.jpg saved to cache
2026-03-28 12:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 05f82b77-8d52-52f3-a982-0584a35cf205
2026-03-28 12:06:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_1ac8b591d3fa39100f3201bf07890ba7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GD51545> (referer: https://www.auto1.com/v1/car-details-view/GD51545/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5fc6d0>
2026-03-28 12:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05f82b77-8d52-52f3-a982-0584a35cf205/05f82b77-8d52-52f3-a982-0584a35cf205_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe4%252F98e4406fee40735271344bce32758766%252Fpa%252FLU04143_1ac8b591d3fa39100f3201bf07890ba7.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_1ac8b591d3fa39100f3201bf07890ba7.jpg saved to cache
2026-03-28 12:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 05f82b77-8d52-52f3-a982-0584a35cf205
2026-03-28 12:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_358c8690b8b92cf634ca82268432d992.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_4c05bc0936b362e3bc4e096ff7233da3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_108f33bca457f4f851776ae8d81c4968.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VB56015/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbdc37d8-83c1-576e-9ad5-1a040d503d19 with identifier: GD51545
2026-03-28 12:06:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbdc37d8-83c1-576e-9ad5-1a040d503d19 with scrape type 1
2026-03-28 12:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dbdc37d8-83c1-576e-9ad5-1a040d503d19
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F48%252Fe248c720aeed58ebc8ade453fc6cd2e3%252Fpa%252FGD51545_70fc30230bb45b0e1bc48f0c4d1ba9b2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_70fc30230bb45b0e1bc48f0c4d1ba9b2.jpg not downloaded yet
2026-03-28 12:06:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F48%252Fe248c720aeed58ebc8ade453fc6cd2e3%252Fpa%252FGD51545_851621c89225a949e056a892b754e97d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_851621c89225a949e056a892b754e97d.jpg not downloaded yet
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F48%252Fe248c720aeed58ebc8ade453fc6cd2e3%252Fpa%252FGD51545_1bb722825f07b55986eda87c73fc9fd0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_1bb722825f07b55986eda87c73fc9fd0.jpg not downloaded yet
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F48%252Fe248c720aeed58ebc8ade453fc6cd2e3%252Fpa%252FGD51545_14a877021f29bf6696cf19e9e10bc575.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_14a877021f29bf6696cf19e9e10bc575.jpg not downloaded yet
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F48%252Fe248c720aeed58ebc8ade453fc6cd2e3%252Fpa%252FGD51545_94e0cfed955db6590b20a7e13ac2e6d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_94e0cfed955db6590b20a7e13ac2e6d8.jpg not downloaded yet
2026-03-28 12:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc65d390>
2026-03-28 12:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05f82b77-8d52-52f3-a982-0584a35cf205/05f82b77-8d52-52f3-a982-0584a35cf205_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe4%252F98e4406fee40735271344bce32758766%252Fpa%252FLU04143_358c8690b8b92cf634ca82268432d992.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_358c8690b8b92cf634ca82268432d992.jpg saved to cache
2026-03-28 12:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 05f82b77-8d52-52f3-a982-0584a35cf205
2026-03-28 12:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc59ab90>
2026-03-28 12:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05f82b77-8d52-52f3-a982-0584a35cf205/05f82b77-8d52-52f3-a982-0584a35cf205_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe4%252F98e4406fee40735271344bce32758766%252Fpa%252FLU04143_4c05bc0936b362e3bc4e096ff7233da3.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_4c05bc0936b362e3bc4e096ff7233da3.jpg saved to cache
2026-03-28 12:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 05f82b77-8d52-52f3-a982-0584a35cf205
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F48%252Fe248c720aeed58ebc8ade453fc6cd2e3%252Fpa%252FGD51545_a2725a3a1cdb955e7e27c1e99ee45877.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_a2725a3a1cdb955e7e27c1e99ee45877.jpg not downloaded yet
2026-03-28 12:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bdd7e050>
2026-03-28 12:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_879e56cb-6dfd-584f-b307-a60aa53227cc/879e56cb-6dfd-584f-b307-a60aa53227cc_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F3e%252F153ee8bb06b005df8e199eafa507c95d%252Fpa%252FZX02617_108f33bca457f4f851776ae8d81c4968.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_108f33bca457f4f851776ae8d81c4968.jpg saved to cache
2026-03-28 12:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 879e56cb-6dfd-584f-b307-a60aa53227cc
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F48%252Fe248c720aeed58ebc8ade453fc6cd2e3%252Fpa%252FGD51545_248ffe7e2f3581d379d161e76668c3c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_248ffe7e2f3581d379d161e76668c3c6.jpg not downloaded yet
2026-03-28 12:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UD61440> (referer: https://www.auto1.com/v1/car-details-view/UD61440/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_2ba2bc31dceac7e13eb54cd28211475d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_69556f78078d946bdde73d6b64a4da3a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F48%252Fe248c720aeed58ebc8ade453fc6cd2e3%252Fpa%252FGD51545_e6a6ba99cdb69cee6ef8d3423d6fd0a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_e6a6ba99cdb69cee6ef8d3423d6fd0a3.jpg not downloaded yet
2026-03-28 12:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_fdb8bd0a8267fde16ff781ec3116b01d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F48%252Fe248c720aeed58ebc8ade453fc6cd2e3%252Fpa%252FGD51545_3b62322d23d7b2878eeb5d8ac3d6782a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_3b62322d23d7b2878eeb5d8ac3d6782a.jpg not downloaded yet
2026-03-28 12:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WG00273/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F48%252Fe248c720aeed58ebc8ade453fc6cd2e3%252Fpa%252FGD51545_50ed819ffdc8243ae6468ec1ce5c9f92.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_50ed819ffdc8243ae6468ec1ce5c9f92.jpg not downloaded yet
2026-03-28 12:06:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e7dcd7d-102b-5040-8b00-8247980db4a5 with identifier: UD61440
2026-03-28 12:06:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e7dcd7d-102b-5040-8b00-8247980db4a5 with scrape type 1
2026-03-28 12:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 1e7dcd7d-102b-5040-8b00-8247980db4a5
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F71%252F38714f399d6082d8bc2c51d42dd3222e%252Fpa%252FUD61440_81cf65da4b5f51c02983983b42a783f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/71/38714f399d6082d8bc2c51d42dd3222e/pa/UD61440_81cf65da4b5f51c02983983b42a783f0.jpg not downloaded yet
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F71%252F38714f399d6082d8bc2c51d42dd3222e%252Fpa%252FUD61440_a5fc91d9fcb73eb198ffd83a5929a965.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/71/38714f399d6082d8bc2c51d42dd3222e/pa/UD61440_a5fc91d9fcb73eb198ffd83a5929a965.jpg not downloaded yet
2026-03-28 12:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_6f015a0917dfb4929c301fcb790eb0f1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc40de50>
2026-03-28 12:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_879e56cb-6dfd-584f-b307-a60aa53227cc/879e56cb-6dfd-584f-b307-a60aa53227cc_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F3e%252F153ee8bb06b005df8e199eafa507c95d%252Fpa%252FZX02617_2ba2bc31dceac7e13eb54cd28211475d.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_2ba2bc31dceac7e13eb54cd28211475d.jpg saved to cache
2026-03-28 12:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 879e56cb-6dfd-584f-b307-a60aa53227cc
2026-03-28 12:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3d7c90>
2026-03-28 12:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05f82b77-8d52-52f3-a982-0584a35cf205/05f82b77-8d52-52f3-a982-0584a35cf205_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe4%252F98e4406fee40735271344bce32758766%252Fpa%252FLU04143_69556f78078d946bdde73d6b64a4da3a.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_69556f78078d946bdde73d6b64a4da3a.jpg saved to cache
2026-03-28 12:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 05f82b77-8d52-52f3-a982-0584a35cf205
2026-03-28 12:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_244f8280d9072f6ae4f1ead0b09a49a0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F71%252F38714f399d6082d8bc2c51d42dd3222e%252Fpa%252FUD61440_bc4d2eeda4e5578c7c421f0b7a30f7c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/71/38714f399d6082d8bc2c51d42dd3222e/pa/UD61440_bc4d2eeda4e5578c7c421f0b7a30f7c8.jpg not downloaded yet
2026-03-28 12:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_248ffe7e2f3581d379d161e76668c3c6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_a2725a3a1cdb955e7e27c1e99ee45877.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_94e0cfed955db6590b20a7e13ac2e6d8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_3b62322d23d7b2878eeb5d8ac3d6782a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F71%252F38714f399d6082d8bc2c51d42dd3222e%252Fpa%252FUD61440_dc4ddbcc30a748bbcc271afc646dee5a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/71/38714f399d6082d8bc2c51d42dd3222e/pa/UD61440_dc4ddbcc30a748bbcc271afc646dee5a.jpg not downloaded yet
2026-03-28 12:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LD34697/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FW12151> (referer: https://www.auto1.com/v1/car-details-view/FW12151/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F71%252F38714f399d6082d8bc2c51d42dd3222e%252Fpa%252FUD61440_cc7395fc145f791a2d5435254a831dea.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/71/38714f399d6082d8bc2c51d42dd3222e/pa/UD61440_cc7395fc145f791a2d5435254a831dea.jpg not downloaded yet
2026-03-28 12:06:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc487ad0>
2026-03-28 12:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05f82b77-8d52-52f3-a982-0584a35cf205/05f82b77-8d52-52f3-a982-0584a35cf205_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe4%252F98e4406fee40735271344bce32758766%252Fpa%252FLU04143_fdb8bd0a8267fde16ff781ec3116b01d.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_fdb8bd0a8267fde16ff781ec3116b01d.jpg saved to cache
2026-03-28 12:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 05f82b77-8d52-52f3-a982-0584a35cf205
2026-03-28 12:06:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc384790>
2026-03-28 12:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05f82b77-8d52-52f3-a982-0584a35cf205/05f82b77-8d52-52f3-a982-0584a35cf205_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe4%252F98e4406fee40735271344bce32758766%252Fpa%252FLU04143_6f015a0917dfb4929c301fcb790eb0f1.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_6f015a0917dfb4929c301fcb790eb0f1.jpg saved to cache
2026-03-28 12:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 05f82b77-8d52-52f3-a982-0584a35cf205
2026-03-28 12:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LS68308> (referer: https://www.auto1.com/v1/car-details-view/LS68308/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc629550>
2026-03-28 12:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05f82b77-8d52-52f3-a982-0584a35cf205/05f82b77-8d52-52f3-a982-0584a35cf205_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe4%252F98e4406fee40735271344bce32758766%252Fpa%252FLU04143_244f8280d9072f6ae4f1ead0b09a49a0.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_244f8280d9072f6ae4f1ead0b09a49a0.jpg saved to cache
2026-03-28 12:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 05f82b77-8d52-52f3-a982-0584a35cf205
2026-03-28 12:06:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 05f82b77-8d52-52f3-a982-0584a35cf205, skipping ID generation
2026-03-28 12:06:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05f82b77-8d52-52f3-a982-0584a35cf205 with scrape type 1
2026-03-28 12:06:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 05f82b77-8d52-52f3-a982-0584a35cf205 sending to next pipeline
2026-03-28 12:06:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 05f82b77-8d52-52f3-a982-0584a35cf205, identifier: LU04143
2026-03-28 12:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bf283790>
2026-03-28 12:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbdc37d8-83c1-576e-9ad5-1a040d503d19/dbdc37d8-83c1-576e-9ad5-1a040d503d19_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F48%252Fe248c720aeed58ebc8ade453fc6cd2e3%252Fpa%252FGD51545_248ffe7e2f3581d379d161e76668c3c6.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_248ffe7e2f3581d379d161e76668c3c6.jpg saved to cache
2026-03-28 12:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dbdc37d8-83c1-576e-9ad5-1a040d503d19
2026-03-28 12:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bdd7c7d0>
2026-03-28 12:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbdc37d8-83c1-576e-9ad5-1a040d503d19/dbdc37d8-83c1-576e-9ad5-1a040d503d19_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F48%252Fe248c720aeed58ebc8ade453fc6cd2e3%252Fpa%252FGD51545_a2725a3a1cdb955e7e27c1e99ee45877.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_a2725a3a1cdb955e7e27c1e99ee45877.jpg saved to cache
2026-03-28 12:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dbdc37d8-83c1-576e-9ad5-1a040d503d19
2026-03-28 12:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd0736d0>
2026-03-28 12:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbdc37d8-83c1-576e-9ad5-1a040d503d19/dbdc37d8-83c1-576e-9ad5-1a040d503d19_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F48%252Fe248c720aeed58ebc8ade453fc6cd2e3%252Fpa%252FGD51545_94e0cfed955db6590b20a7e13ac2e6d8.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_94e0cfed955db6590b20a7e13ac2e6d8.jpg saved to cache
2026-03-28 12:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dbdc37d8-83c1-576e-9ad5-1a040d503d19
2026-03-28 12:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc545210>
2026-03-28 12:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbdc37d8-83c1-576e-9ad5-1a040d503d19/dbdc37d8-83c1-576e-9ad5-1a040d503d19_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F48%252Fe248c720aeed58ebc8ade453fc6cd2e3%252Fpa%252FGD51545_3b62322d23d7b2878eeb5d8ac3d6782a.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_3b62322d23d7b2878eeb5d8ac3d6782a.jpg saved to cache
2026-03-28 12:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dbdc37d8-83c1-576e-9ad5-1a040d503d19
2026-03-28 12:06:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50f93761-165c-58a3-af1e-21ed0d6f13ab with identifier: FW12151
2026-03-28 12:06:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50f93761-165c-58a3-af1e-21ed0d6f13ab with scrape type 1
2026-03-28 12:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 50f93761-165c-58a3-af1e-21ed0d6f13ab
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fb2%252F6db2a225b296e02c60e7c629057b9411%252Fpa%252FFW12151_44351c96a942fe3984afd75880483808.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/b2/6db2a225b296e02c60e7c629057b9411/pa/FW12151_44351c96a942fe3984afd75880483808.jpg already downloaded
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fb2%252F6db2a225b296e02c60e7c629057b9411%252Fpa%252FFW12151_e1752d71f4e76aeac29be9c46e591f70.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/b2/6db2a225b296e02c60e7c629057b9411/pa/FW12151_e1752d71f4e76aeac29be9c46e591f70.jpg already downloaded
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fb2%252F6db2a225b296e02c60e7c629057b9411%252Fpa%252FFW12151_e99cb7cf3b8749f22241ed44ebf8d3e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/b2/6db2a225b296e02c60e7c629057b9411/pa/FW12151_e99cb7cf3b8749f22241ed44ebf8d3e3.jpg already downloaded
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fb2%252F6db2a225b296e02c60e7c629057b9411%252Fpa%252FFW12151_880cda6fa001bd12efe7548d602d4c64.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/b2/6db2a225b296e02c60e7c629057b9411/pa/FW12151_880cda6fa001bd12efe7548d602d4c64.jpg already downloaded
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fb2%252F6db2a225b296e02c60e7c629057b9411%252Fpa%252FFW12151_ac4f9c82862f89d31db37cb5485331d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/b2/6db2a225b296e02c60e7c629057b9411/pa/FW12151_ac4f9c82862f89d31db37cb5485331d2.jpg already downloaded
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fb2%252F6db2a225b296e02c60e7c629057b9411%252Fpa%252FFW12151_c76254135ae03996fba74782095f6af9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/b2/6db2a225b296e02c60e7c629057b9411/pa/FW12151_c76254135ae03996fba74782095f6af9.jpg already downloaded
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fb2%252F6db2a225b296e02c60e7c629057b9411%252Fpa%252FFW12151_8438cfeb8977b4ea4a6ead8e01c9c659.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/b2/6db2a225b296e02c60e7c629057b9411/pa/FW12151_8438cfeb8977b4ea4a6ead8e01c9c659.jpg already downloaded
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fb2%252F6db2a225b296e02c60e7c629057b9411%252Fpa%252FFW12151_4822a67775b1a7281a0226e46367f99f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/b2/6db2a225b296e02c60e7c629057b9411/pa/FW12151_4822a67775b1a7281a0226e46367f99f.jpg already downloaded
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fb2%252F6db2a225b296e02c60e7c629057b9411%252Fpa%252FFW12151_14b02a8b83003720cf4ce124f731360d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/b2/6db2a225b296e02c60e7c629057b9411/pa/FW12151_14b02a8b83003720cf4ce124f731360d.jpg already downloaded
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fb2%252F6db2a225b296e02c60e7c629057b9411%252Fpa%252FFW12151_e0df2a3df6e9db486924191b16000f19.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/b2/6db2a225b296e02c60e7c629057b9411/pa/FW12151_e0df2a3df6e9db486924191b16000f19.jpg already downloaded
2026-03-28 12:06:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 50f93761-165c-58a3-af1e-21ed0d6f13ab, identifier: FW12151
2026-03-28 12:06:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 05f82b77-8d52-52f3-a982-0584a35cf205 with identifier: LU04143
2026-03-28 12:06:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 05f82b77-8d52-52f3-a982-0584a35cf205 with identifier: LU04143
2026-03-28 12:06:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 05f82b77-8d52-52f3-a982-0584a35cf205 with identifier: LU04143 to the API
2026-03-28 12:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_244f8280d9072f6ae4f1ead0b09a49a0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:52:00Z',
 'fuel_type': 'diesel',
 'id': '05f82b77-8d52-52f3-a982-0584a35cf205',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU04143',
 'listing': 'auction',
 'location': 'IT, Beinasco',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 187217,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05f82b77-8d52-52f3-a982-0584a35cf205/05f82b77-8d52-52f3-a982-0584a35cf205_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_4c05bc0936b362e3bc4e096ff7233da3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05f82b77-8d52-52f3-a982-0584a35cf205/05f82b77-8d52-52f3-a982-0584a35cf205_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_358c8690b8b92cf634ca82268432d992.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05f82b77-8d52-52f3-a982-0584a35cf205/05f82b77-8d52-52f3-a982-0584a35cf205_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2395018,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_244f8280d9072f6ae4f1ead0b09a49a0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05f82b77-8d52-52f3-a982-0584a35cf205/05f82b77-8d52-52f3-a982-0584a35cf205_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2294404,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_69556f78078d946bdde73d6b64a4da3a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05f82b77-8d52-52f3-a982-0584a35cf205/05f82b77-8d52-52f3-a982-0584a35cf205_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2482968,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_fdb8bd0a8267fde16ff781ec3116b01d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05f82b77-8d52-52f3-a982-0584a35cf205/05f82b77-8d52-52f3-a982-0584a35cf205_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2483151,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_6f015a0917dfb4929c301fcb790eb0f1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05f82b77-8d52-52f3-a982-0584a35cf205/05f82b77-8d52-52f3-a982-0584a35cf205_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_23e7ed396d44d9d22f70651961d80bf9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05f82b77-8d52-52f3-a982-0584a35cf205/05f82b77-8d52-52f3-a982-0584a35cf205_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_49a521643aa5b3fa5becfd63209a9a01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05f82b77-8d52-52f3-a982-0584a35cf205/05f82b77-8d52-52f3-a982-0584a35cf205_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_8304542e0fd5f20e5e0217d85eeb5e25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05f82b77-8d52-52f3-a982-0584a35cf205/05f82b77-8d52-52f3-a982-0584a35cf205_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2839952,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/e4/98e4406fee40735271344bce32758766/pa/LU04143_1ac8b591d3fa39100f3201bf07890ba7.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-11-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500X 1.3 M-Jet Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2015}
2026-03-28 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU04143%27 HTTP/1.1" 200 None
2026-03-28 12:06:49 [auto1.it] INFO: Saving data for LU04143: {'created_time': 1774699609.719665, 'last_price_update_time': 1774699609.719678, 'auction_closing_time': 1774885920.0}
2026-03-28 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LU04143') HTTP/1.1" 204 0
2026-03-28 12:06:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 50f93761-165c-58a3-af1e-21ed0d6f13ab with identifier: FW12151
2026-03-28 12:06:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 50f93761-165c-58a3-af1e-21ed0d6f13ab with identifier: FW12151
2026-03-28 12:06:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 50f93761-165c-58a3-af1e-21ed0d6f13ab with identifier: FW12151 to the API
2026-03-28 12:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FW12151>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:00:24Z',
 'fuel_type': 'petrol',
 'id': '50f93761-165c-58a3-af1e-21ed0d6f13ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW12151',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Fiat',
 'model': '500',
 'odometer': 89240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photo_urls': ['https://img-pa.auto1.com/img6d/b2/6db2a225b296e02c60e7c629057b9411/pa/FW12151_44351c96a942fe3984afd75880483808.jpg',
                'https://img-pa.auto1.com/img6d/b2/6db2a225b296e02c60e7c629057b9411/pa/FW12151_e1752d71f4e76aeac29be9c46e591f70.jpg',
                'https://img-pa.auto1.com/img6d/b2/6db2a225b296e02c60e7c629057b9411/pa/FW12151_e99cb7cf3b8749f22241ed44ebf8d3e3.jpg',
                'https://img-pa.auto1.com/img6d/b2/6db2a225b296e02c60e7c629057b9411/pa/FW12151_880cda6fa001bd12efe7548d602d4c64.jpg',
                'https://img-pa.auto1.com/img6d/b2/6db2a225b296e02c60e7c629057b9411/pa/FW12151_ac4f9c82862f89d31db37cb5485331d2.jpg',
                'https://img-pa.auto1.com/img6d/b2/6db2a225b296e02c60e7c629057b9411/pa/FW12151_c76254135ae03996fba74782095f6af9.jpg',
                'https://img-pa.auto1.com/img6d/b2/6db2a225b296e02c60e7c629057b9411/pa/FW12151_8438cfeb8977b4ea4a6ead8e01c9c659.jpg',
                'https://img-pa.auto1.com/img6d/b2/6db2a225b296e02c60e7c629057b9411/pa/FW12151_4822a67775b1a7281a0226e46367f99f.jpg',
                'https://img-pa.auto1.com/img6d/b2/6db2a225b296e02c60e7c629057b9411/pa/FW12151_14b02a8b83003720cf4ce124f731360d.jpg',
                'https://img-pa.auto1.com/img6d/b2/6db2a225b296e02c60e7c629057b9411/pa/FW12151_e0df2a3df6e9db486924191b16000f19.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50f93761-165c-58a3-af1e-21ed0d6f13ab/50f93761-165c-58a3-af1e-21ed0d6f13ab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 178176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/b2/6db2a225b296e02c60e7c629057b9411/pa/FW12151_44351c96a942fe3984afd75880483808.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50f93761-165c-58a3-af1e-21ed0d6f13ab/50f93761-165c-58a3-af1e-21ed0d6f13ab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 178176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/b2/6db2a225b296e02c60e7c629057b9411/pa/FW12151_e1752d71f4e76aeac29be9c46e591f70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50f93761-165c-58a3-af1e-21ed0d6f13ab/50f93761-165c-58a3-af1e-21ed0d6f13ab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 170256,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/b2/6db2a225b296e02c60e7c629057b9411/pa/FW12151_e99cb7cf3b8749f22241ed44ebf8d3e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50f93761-165c-58a3-af1e-21ed0d6f13ab/50f93761-165c-58a3-af1e-21ed0d6f13ab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 159174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/b2/6db2a225b296e02c60e7c629057b9411/pa/FW12151_880cda6fa001bd12efe7548d602d4c64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50f93761-165c-58a3-af1e-21ed0d6f13ab/50f93761-165c-58a3-af1e-21ed0d6f13ab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 177795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/b2/6db2a225b296e02c60e7c629057b9411/pa/FW12151_ac4f9c82862f89d31db37cb5485331d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50f93761-165c-58a3-af1e-21ed0d6f13ab/50f93761-165c-58a3-af1e-21ed0d6f13ab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 180598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/b2/6db2a225b296e02c60e7c629057b9411/pa/FW12151_c76254135ae03996fba74782095f6af9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50f93761-165c-58a3-af1e-21ed0d6f13ab/50f93761-165c-58a3-af1e-21ed0d6f13ab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 157595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/b2/6db2a225b296e02c60e7c629057b9411/pa/FW12151_8438cfeb8977b4ea4a6ead8e01c9c659.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50f93761-165c-58a3-af1e-21ed0d6f13ab/50f93761-165c-58a3-af1e-21ed0d6f13ab_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 163761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/b2/6db2a225b296e02c60e7c629057b9411/pa/FW12151_4822a67775b1a7281a0226e46367f99f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50f93761-165c-58a3-af1e-21ed0d6f13ab/50f93761-165c-58a3-af1e-21ed0d6f13ab_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 144326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/b2/6db2a225b296e02c60e7c629057b9411/pa/FW12151_14b02a8b83003720cf4ce124f731360d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50f93761-165c-58a3-af1e-21ed0d6f13ab/50f93761-165c-58a3-af1e-21ed0d6f13ab_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 137400,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/b2/6db2a225b296e02c60e7c629057b9411/pa/FW12151_e0df2a3df6e9db486924191b16000f19.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-04-19',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2010}
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FW12151%27 HTTP/1.1" 200 None
2026-03-28 12:06:50 [auto1.it] INFO: Saving data for FW12151: {'created_time': 1774699610.212695, 'last_price_update_time': 1774699610.212707, 'auction_closing_time': 1774882824.0}
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FW12151') HTTP/1.1" 204 0
2026-03-28 12:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_50ed819ffdc8243ae6468ec1ce5c9f92.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NB70789> (referer: https://www.auto1.com/v1/car-details-view/NB70789/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LB50046> (referer: https://www.auto1.com/v1/car-details-view/LB50046/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_787e563be0507c190b87cbb80e17983a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/71/38714f399d6082d8bc2c51d42dd3222e/pa/UD61440_81cf65da4b5f51c02983983b42a783f0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/71/38714f399d6082d8bc2c51d42dd3222e/pa/UD61440_bc4d2eeda4e5578c7c421f0b7a30f7c8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/71/38714f399d6082d8bc2c51d42dd3222e/pa/UD61440_cc7395fc145f791a2d5435254a831dea.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/71/38714f399d6082d8bc2c51d42dd3222e/pa/UD61440_a5fc91d9fcb73eb198ffd83a5929a965.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/71/38714f399d6082d8bc2c51d42dd3222e/pa/UD61440_dc4ddbcc30a748bbcc271afc646dee5a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_e6a6ba99cdb69cee6ef8d3423d6fd0a3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BC13106> (referer: https://www.auto1.com/v1/car-details-view/BC13106/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be04f711-f980-59c2-9ef7-f4aa908022f7 with identifier: LS68308
2026-03-28 12:06:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be04f711-f980-59c2-9ef7-f4aa908022f7 with scrape type 1
2026-03-28 12:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item be04f711-f980-59c2-9ef7-f4aa908022f7
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Faf%252Fd9af1c910f6409afb3411ed220f055fe%252Fpa%252FLS68308_0108c895e905d9b5357ef3effee787ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/af/d9af1c910f6409afb3411ed220f055fe/pa/LS68308_0108c895e905d9b5357ef3effee787ea.jpg already downloaded
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Faf%252Fd9af1c910f6409afb3411ed220f055fe%252Fpa%252FLS68308_d8e63164b5c457f90da170ac6d8a9dba.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/af/d9af1c910f6409afb3411ed220f055fe/pa/LS68308_d8e63164b5c457f90da170ac6d8a9dba.jpg already downloaded
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Faf%252Fd9af1c910f6409afb3411ed220f055fe%252Fpa%252FLS68308_e0be72f9bced9ee872b863c58a216c87.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/af/d9af1c910f6409afb3411ed220f055fe/pa/LS68308_e0be72f9bced9ee872b863c58a216c87.jpg already downloaded
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Faf%252Fd9af1c910f6409afb3411ed220f055fe%252Fpa%252FLS68308_bab7899d2e7e9fd85c1d450136fa9a2a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/af/d9af1c910f6409afb3411ed220f055fe/pa/LS68308_bab7899d2e7e9fd85c1d450136fa9a2a.jpg already downloaded
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Faf%252Fd9af1c910f6409afb3411ed220f055fe%252Fpa%252FLS68308_d70e5c08289c223f7fbb018d10be390b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/af/d9af1c910f6409afb3411ed220f055fe/pa/LS68308_d70e5c08289c223f7fbb018d10be390b.jpg already downloaded
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Faf%252Fd9af1c910f6409afb3411ed220f055fe%252Fpa%252FLS68308_bcc0de956d226088062771aa062e5487.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/af/d9af1c910f6409afb3411ed220f055fe/pa/LS68308_bcc0de956d226088062771aa062e5487.jpg already downloaded
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Faf%252Fd9af1c910f6409afb3411ed220f055fe%252Fpa%252FLS68308_1f35e31e7180c250ab2e41caf044efc4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/af/d9af1c910f6409afb3411ed220f055fe/pa/LS68308_1f35e31e7180c250ab2e41caf044efc4.jpg already downloaded
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Faf%252Fd9af1c910f6409afb3411ed220f055fe%252Fpa%252FLS68308_5c7b2ec2c5b70b056126bafd2bd2b218.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/af/d9af1c910f6409afb3411ed220f055fe/pa/LS68308_5c7b2ec2c5b70b056126bafd2bd2b218.jpg already downloaded
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Faf%252Fd9af1c910f6409afb3411ed220f055fe%252Fpa%252FLS68308_3a7e9572b005247422ce43e00a000bca.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/af/d9af1c910f6409afb3411ed220f055fe/pa/LS68308_3a7e9572b005247422ce43e00a000bca.jpg already downloaded
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Faf%252Fd9af1c910f6409afb3411ed220f055fe%252Fpa%252FLS68308_653e2a1b403bb330ac21fba0e93c5412.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/af/d9af1c910f6409afb3411ed220f055fe/pa/LS68308_653e2a1b403bb330ac21fba0e93c5412.jpg already downloaded
2026-03-28 12:06:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: be04f711-f980-59c2-9ef7-f4aa908022f7, identifier: LS68308
2026-03-28 12:06:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: be04f711-f980-59c2-9ef7-f4aa908022f7 with identifier: LS68308
2026-03-28 12:06:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: be04f711-f980-59c2-9ef7-f4aa908022f7 with identifier: LS68308
2026-03-28 12:06:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: be04f711-f980-59c2-9ef7-f4aa908022f7 with identifier: LS68308 to the API
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LS68308>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:22:27Z',
 'fuel_type': 'diesel',
 'id': 'be04f711-f980-59c2-9ef7-f4aa908022f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS68308',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Nissan',
 'model': 'Pulsar',
 'odometer': 183528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgd9/af/d9af1c910f6409afb3411ed220f055fe/pa/LS68308_0108c895e905d9b5357ef3effee787ea.jpg',
                'https://img-pa.auto1.com/imgd9/af/d9af1c910f6409afb3411ed220f055fe/pa/LS68308_d8e63164b5c457f90da170ac6d8a9dba.jpg',
                'https://img-pa.auto1.com/imgd9/af/d9af1c910f6409afb3411ed220f055fe/pa/LS68308_e0be72f9bced9ee872b863c58a216c87.jpg',
                'https://img-pa.auto1.com/imgd9/af/d9af1c910f6409afb3411ed220f055fe/pa/LS68308_bab7899d2e7e9fd85c1d450136fa9a2a.jpg',
                'https://img-pa.auto1.com/imgd9/af/d9af1c910f6409afb3411ed220f055fe/pa/LS68308_d70e5c08289c223f7fbb018d10be390b.jpg',
                'https://img-pa.auto1.com/imgd9/af/d9af1c910f6409afb3411ed220f055fe/pa/LS68308_bcc0de956d226088062771aa062e5487.jpg',
                'https://img-pa.auto1.com/imgd9/af/d9af1c910f6409afb3411ed220f055fe/pa/LS68308_1f35e31e7180c250ab2e41caf044efc4.jpg',
                'https://img-pa.auto1.com/imgd9/af/d9af1c910f6409afb3411ed220f055fe/pa/LS68308_5c7b2ec2c5b70b056126bafd2bd2b218.jpg',
                'https://img-pa.auto1.com/imgd9/af/d9af1c910f6409afb3411ed220f055fe/pa/LS68308_3a7e9572b005247422ce43e00a000bca.jpg',
                'https://img-pa.auto1.com/imgd9/af/d9af1c910f6409afb3411ed220f055fe/pa/LS68308_653e2a1b403bb330ac21fba0e93c5412.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be04f711-f980-59c2-9ef7-f4aa908022f7/be04f711-f980-59c2-9ef7-f4aa908022f7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61740,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/af/d9af1c910f6409afb3411ed220f055fe/pa/LS68308_0108c895e905d9b5357ef3effee787ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be04f711-f980-59c2-9ef7-f4aa908022f7/be04f711-f980-59c2-9ef7-f4aa908022f7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/af/d9af1c910f6409afb3411ed220f055fe/pa/LS68308_d8e63164b5c457f90da170ac6d8a9dba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be04f711-f980-59c2-9ef7-f4aa908022f7/be04f711-f980-59c2-9ef7-f4aa908022f7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/af/d9af1c910f6409afb3411ed220f055fe/pa/LS68308_e0be72f9bced9ee872b863c58a216c87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be04f711-f980-59c2-9ef7-f4aa908022f7/be04f711-f980-59c2-9ef7-f4aa908022f7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54930,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/af/d9af1c910f6409afb3411ed220f055fe/pa/LS68308_bab7899d2e7e9fd85c1d450136fa9a2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be04f711-f980-59c2-9ef7-f4aa908022f7/be04f711-f980-59c2-9ef7-f4aa908022f7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/af/d9af1c910f6409afb3411ed220f055fe/pa/LS68308_d70e5c08289c223f7fbb018d10be390b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be04f711-f980-59c2-9ef7-f4aa908022f7/be04f711-f980-59c2-9ef7-f4aa908022f7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/af/d9af1c910f6409afb3411ed220f055fe/pa/LS68308_bcc0de956d226088062771aa062e5487.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be04f711-f980-59c2-9ef7-f4aa908022f7/be04f711-f980-59c2-9ef7-f4aa908022f7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/af/d9af1c910f6409afb3411ed220f055fe/pa/LS68308_1f35e31e7180c250ab2e41caf044efc4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be04f711-f980-59c2-9ef7-f4aa908022f7/be04f711-f980-59c2-9ef7-f4aa908022f7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/af/d9af1c910f6409afb3411ed220f055fe/pa/LS68308_5c7b2ec2c5b70b056126bafd2bd2b218.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be04f711-f980-59c2-9ef7-f4aa908022f7/be04f711-f980-59c2-9ef7-f4aa908022f7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/af/d9af1c910f6409afb3411ed220f055fe/pa/LS68308_3a7e9572b005247422ce43e00a000bca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be04f711-f980-59c2-9ef7-f4aa908022f7/be04f711-f980-59c2-9ef7-f4aa908022f7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/af/d9af1c910f6409afb3411ed220f055fe/pa/LS68308_653e2a1b403bb330ac21fba0e93c5412.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Pulsar 1.5 Turbodiesel Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2015}
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS68308%27 HTTP/1.1" 200 None
2026-03-28 12:06:50 [auto1.it] INFO: Saving data for LS68308: {'created_time': 1774699610.856189, 'last_price_update_time': 1774699610.8562, 'auction_closing_time': 1774884147.0}
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LS68308') HTTP/1.1" 204 0
2026-03-28 12:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_14a877021f29bf6696cf19e9e10bc575.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bceac890>
2026-03-28 12:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbdc37d8-83c1-576e-9ad5-1a040d503d19/dbdc37d8-83c1-576e-9ad5-1a040d503d19_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F48%252Fe248c720aeed58ebc8ade453fc6cd2e3%252Fpa%252FGD51545_50ed819ffdc8243ae6468ec1ce5c9f92.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_50ed819ffdc8243ae6468ec1ce5c9f92.jpg saved to cache
2026-03-28 12:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dbdc37d8-83c1-576e-9ad5-1a040d503d19
2026-03-28 12:06:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a0bd5fb-40ab-5cdd-804d-90031e1efb58 with identifier: NB70789
2026-03-28 12:06:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a0bd5fb-40ab-5cdd-804d-90031e1efb58 with scrape type 1
2026-03-28 12:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3a0bd5fb-40ab-5cdd-804d-90031e1efb58
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2b%252F3d2b37a76e11781e42434b3d20fc4334%252Fpa%252FNB70789_5b44c2434f3eb93935d68102abadea3a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2b/3d2b37a76e11781e42434b3d20fc4334/pa/NB70789_5b44c2434f3eb93935d68102abadea3a.jpg already downloaded
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2b%252F3d2b37a76e11781e42434b3d20fc4334%252Fpa%252FNB70789_b0498ec0b43c04ecb53af7352ef4b433.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2b/3d2b37a76e11781e42434b3d20fc4334/pa/NB70789_b0498ec0b43c04ecb53af7352ef4b433.jpg already downloaded
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2b%252F3d2b37a76e11781e42434b3d20fc4334%252Fpa%252FNB70789_98ee7c12636d86161c195fe36b52332e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2b/3d2b37a76e11781e42434b3d20fc4334/pa/NB70789_98ee7c12636d86161c195fe36b52332e.jpg already downloaded
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2b%252F3d2b37a76e11781e42434b3d20fc4334%252Fpa%252FNB70789_10defe2eff11e5fb1872a15e64fe55d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2b/3d2b37a76e11781e42434b3d20fc4334/pa/NB70789_10defe2eff11e5fb1872a15e64fe55d1.jpg already downloaded
2026-03-28 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2b%252F3d2b37a76e11781e42434b3d20fc4334%252Fpa%252FNB70789_e64169bd4af0d3b17ad0e7f4b074a413.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2b/3d2b37a76e11781e42434b3d20fc4334/pa/NB70789_e64169bd4af0d3b17ad0e7f4b074a413.jpg already downloaded
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2b%252F3d2b37a76e11781e42434b3d20fc4334%252Fpa%252FNB70789_cfdaada8fcb902421992b6623071f13f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2b/3d2b37a76e11781e42434b3d20fc4334/pa/NB70789_cfdaada8fcb902421992b6623071f13f.jpg already downloaded
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2b%252F3d2b37a76e11781e42434b3d20fc4334%252Fpa%252FNB70789_b5b5cbfd876dfb336d673706c5e2fbdd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2b/3d2b37a76e11781e42434b3d20fc4334/pa/NB70789_b5b5cbfd876dfb336d673706c5e2fbdd.jpg already downloaded
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2b%252F3d2b37a76e11781e42434b3d20fc4334%252Fpa%252FNB70789_ce74482c6b5c9f965689d1b2ce6500d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2b/3d2b37a76e11781e42434b3d20fc4334/pa/NB70789_ce74482c6b5c9f965689d1b2ce6500d8.jpg already downloaded
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2b%252F3d2b37a76e11781e42434b3d20fc4334%252Fpa%252FNB70789_d469b01f16ac4c47ad71eeaaaaf6cf3e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2b/3d2b37a76e11781e42434b3d20fc4334/pa/NB70789_d469b01f16ac4c47ad71eeaaaaf6cf3e.jpg already downloaded
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2b%252F3d2b37a76e11781e42434b3d20fc4334%252Fpa%252FNB70789_65b03ff01bded5010b249da968774b84.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2b/3d2b37a76e11781e42434b3d20fc4334/pa/NB70789_65b03ff01bded5010b249da968774b84.jpg already downloaded
2026-03-28 12:06:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3a0bd5fb-40ab-5cdd-804d-90031e1efb58, identifier: NB70789
2026-03-28 12:06:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03d9f1cd-13c8-5a12-a075-fc1c6be123f9 with identifier: LB50046
2026-03-28 12:06:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03d9f1cd-13c8-5a12-a075-fc1c6be123f9 with scrape type 1
2026-03-28 12:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 03d9f1cd-13c8-5a12-a075-fc1c6be123f9
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F71%252F397150a64bdccd102587a586d843212d%252Fpa%252FLB50046_8b3de6bca8f857187bb4fe2e451f28e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_8b3de6bca8f857187bb4fe2e451f28e9.jpg not downloaded yet
2026-03-28 12:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc2a7fd0>
2026-03-28 12:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_879e56cb-6dfd-584f-b307-a60aa53227cc/879e56cb-6dfd-584f-b307-a60aa53227cc_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F3e%252F153ee8bb06b005df8e199eafa507c95d%252Fpa%252FZX02617_787e563be0507c190b87cbb80e17983a.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_787e563be0507c190b87cbb80e17983a.jpg saved to cache
2026-03-28 12:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 879e56cb-6dfd-584f-b307-a60aa53227cc
2026-03-28 12:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc2c4e10>
2026-03-28 12:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e7dcd7d-102b-5040-8b00-8247980db4a5/1e7dcd7d-102b-5040-8b00-8247980db4a5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F71%252F38714f399d6082d8bc2c51d42dd3222e%252Fpa%252FUD61440_81cf65da4b5f51c02983983b42a783f0.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/71/38714f399d6082d8bc2c51d42dd3222e/pa/UD61440_81cf65da4b5f51c02983983b42a783f0.jpg saved to cache
2026-03-28 12:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e7dcd7d-102b-5040-8b00-8247980db4a5
2026-03-28 12:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc2d1c10>
2026-03-28 12:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e7dcd7d-102b-5040-8b00-8247980db4a5/1e7dcd7d-102b-5040-8b00-8247980db4a5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F71%252F38714f399d6082d8bc2c51d42dd3222e%252Fpa%252FUD61440_bc4d2eeda4e5578c7c421f0b7a30f7c8.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/71/38714f399d6082d8bc2c51d42dd3222e/pa/UD61440_bc4d2eeda4e5578c7c421f0b7a30f7c8.jpg saved to cache
2026-03-28 12:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1e7dcd7d-102b-5040-8b00-8247980db4a5
2026-03-28 12:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc2d7a10>
2026-03-28 12:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e7dcd7d-102b-5040-8b00-8247980db4a5/1e7dcd7d-102b-5040-8b00-8247980db4a5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F71%252F38714f399d6082d8bc2c51d42dd3222e%252Fpa%252FUD61440_cc7395fc145f791a2d5435254a831dea.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/71/38714f399d6082d8bc2c51d42dd3222e/pa/UD61440_cc7395fc145f791a2d5435254a831dea.jpg saved to cache
2026-03-28 12:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1e7dcd7d-102b-5040-8b00-8247980db4a5
2026-03-28 12:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc2cee50>
2026-03-28 12:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e7dcd7d-102b-5040-8b00-8247980db4a5/1e7dcd7d-102b-5040-8b00-8247980db4a5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F71%252F38714f399d6082d8bc2c51d42dd3222e%252Fpa%252FUD61440_a5fc91d9fcb73eb198ffd83a5929a965.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/71/38714f399d6082d8bc2c51d42dd3222e/pa/UD61440_a5fc91d9fcb73eb198ffd83a5929a965.jpg saved to cache
2026-03-28 12:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1e7dcd7d-102b-5040-8b00-8247980db4a5
2026-03-28 12:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcebe290>
2026-03-28 12:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e7dcd7d-102b-5040-8b00-8247980db4a5/1e7dcd7d-102b-5040-8b00-8247980db4a5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F71%252F38714f399d6082d8bc2c51d42dd3222e%252Fpa%252FUD61440_dc4ddbcc30a748bbcc271afc646dee5a.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/71/38714f399d6082d8bc2c51d42dd3222e/pa/UD61440_dc4ddbcc30a748bbcc271afc646dee5a.jpg saved to cache
2026-03-28 12:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1e7dcd7d-102b-5040-8b00-8247980db4a5
2026-03-28 12:06:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e7dcd7d-102b-5040-8b00-8247980db4a5, skipping ID generation
2026-03-28 12:06:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e7dcd7d-102b-5040-8b00-8247980db4a5 with scrape type 1
2026-03-28 12:06:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e7dcd7d-102b-5040-8b00-8247980db4a5 sending to next pipeline
2026-03-28 12:06:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1e7dcd7d-102b-5040-8b00-8247980db4a5, identifier: UD61440
2026-03-28 12:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5fe410>
2026-03-28 12:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbdc37d8-83c1-576e-9ad5-1a040d503d19/dbdc37d8-83c1-576e-9ad5-1a040d503d19_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F48%252Fe248c720aeed58ebc8ade453fc6cd2e3%252Fpa%252FGD51545_e6a6ba99cdb69cee6ef8d3423d6fd0a3.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_e6a6ba99cdb69cee6ef8d3423d6fd0a3.jpg saved to cache
2026-03-28 12:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dbdc37d8-83c1-576e-9ad5-1a040d503d19
2026-03-28 12:06:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36ce2ae7-4284-57be-bf98-6054721a526e with identifier: BC13106
2026-03-28 12:06:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36ce2ae7-4284-57be-bf98-6054721a526e with scrape type 1
2026-03-28 12:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 36ce2ae7-4284-57be-bf98-6054721a526e
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fbd%252F47bd971ee1470faa6c9f180bf82f1033%252Fpa%252FBC13106_f4f5572edb3c85ef9635a2d42d154dc9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/bd/47bd971ee1470faa6c9f180bf82f1033/pa/BC13106_f4f5572edb3c85ef9635a2d42d154dc9.jpg not downloaded yet
2026-03-28 12:06:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3a0bd5fb-40ab-5cdd-804d-90031e1efb58 with identifier: NB70789
2026-03-28 12:06:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3a0bd5fb-40ab-5cdd-804d-90031e1efb58 with identifier: NB70789
2026-03-28 12:06:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3a0bd5fb-40ab-5cdd-804d-90031e1efb58 with identifier: NB70789 to the API
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NB70789>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:36:35Z',
 'fuel_type': 'diesel',
 'id': '3a0bd5fb-40ab-5cdd-804d-90031e1efb58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB70789',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 328181,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img3d/2b/3d2b37a76e11781e42434b3d20fc4334/pa/NB70789_5b44c2434f3eb93935d68102abadea3a.jpg',
                'https://img-pa.auto1.com/img3d/2b/3d2b37a76e11781e42434b3d20fc4334/pa/NB70789_b0498ec0b43c04ecb53af7352ef4b433.jpg',
                'https://img-pa.auto1.com/img3d/2b/3d2b37a76e11781e42434b3d20fc4334/pa/NB70789_98ee7c12636d86161c195fe36b52332e.jpg',
                'https://img-pa.auto1.com/img3d/2b/3d2b37a76e11781e42434b3d20fc4334/pa/NB70789_10defe2eff11e5fb1872a15e64fe55d1.jpg',
                'https://img-pa.auto1.com/img3d/2b/3d2b37a76e11781e42434b3d20fc4334/pa/NB70789_e64169bd4af0d3b17ad0e7f4b074a413.jpg',
                'https://img-pa.auto1.com/img3d/2b/3d2b37a76e11781e42434b3d20fc4334/pa/NB70789_cfdaada8fcb902421992b6623071f13f.jpg',
                'https://img-pa.auto1.com/img3d/2b/3d2b37a76e11781e42434b3d20fc4334/pa/NB70789_b5b5cbfd876dfb336d673706c5e2fbdd.jpg',
                'https://img-pa.auto1.com/img3d/2b/3d2b37a76e11781e42434b3d20fc4334/pa/NB70789_ce74482c6b5c9f965689d1b2ce6500d8.jpg',
                'https://img-pa.auto1.com/img3d/2b/3d2b37a76e11781e42434b3d20fc4334/pa/NB70789_d469b01f16ac4c47ad71eeaaaaf6cf3e.jpg',
                'https://img-pa.auto1.com/img3d/2b/3d2b37a76e11781e42434b3d20fc4334/pa/NB70789_65b03ff01bded5010b249da968774b84.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a0bd5fb-40ab-5cdd-804d-90031e1efb58/3a0bd5fb-40ab-5cdd-804d-90031e1efb58_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/2b/3d2b37a76e11781e42434b3d20fc4334/pa/NB70789_5b44c2434f3eb93935d68102abadea3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a0bd5fb-40ab-5cdd-804d-90031e1efb58/3a0bd5fb-40ab-5cdd-804d-90031e1efb58_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2771618,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/2b/3d2b37a76e11781e42434b3d20fc4334/pa/NB70789_b0498ec0b43c04ecb53af7352ef4b433.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a0bd5fb-40ab-5cdd-804d-90031e1efb58/3a0bd5fb-40ab-5cdd-804d-90031e1efb58_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/2b/3d2b37a76e11781e42434b3d20fc4334/pa/NB70789_98ee7c12636d86161c195fe36b52332e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a0bd5fb-40ab-5cdd-804d-90031e1efb58/3a0bd5fb-40ab-5cdd-804d-90031e1efb58_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/2b/3d2b37a76e11781e42434b3d20fc4334/pa/NB70789_10defe2eff11e5fb1872a15e64fe55d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a0bd5fb-40ab-5cdd-804d-90031e1efb58/3a0bd5fb-40ab-5cdd-804d-90031e1efb58_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/2b/3d2b37a76e11781e42434b3d20fc4334/pa/NB70789_e64169bd4af0d3b17ad0e7f4b074a413.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a0bd5fb-40ab-5cdd-804d-90031e1efb58/3a0bd5fb-40ab-5cdd-804d-90031e1efb58_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/2b/3d2b37a76e11781e42434b3d20fc4334/pa/NB70789_cfdaada8fcb902421992b6623071f13f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a0bd5fb-40ab-5cdd-804d-90031e1efb58/3a0bd5fb-40ab-5cdd-804d-90031e1efb58_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70629,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/2b/3d2b37a76e11781e42434b3d20fc4334/pa/NB70789_b5b5cbfd876dfb336d673706c5e2fbdd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a0bd5fb-40ab-5cdd-804d-90031e1efb58/3a0bd5fb-40ab-5cdd-804d-90031e1efb58_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76981,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/2b/3d2b37a76e11781e42434b3d20fc4334/pa/NB70789_ce74482c6b5c9f965689d1b2ce6500d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a0bd5fb-40ab-5cdd-804d-90031e1efb58/3a0bd5fb-40ab-5cdd-804d-90031e1efb58_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74777,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/2b/3d2b37a76e11781e42434b3d20fc4334/pa/NB70789_d469b01f16ac4c47ad71eeaaaaf6cf3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a0bd5fb-40ab-5cdd-804d-90031e1efb58/3a0bd5fb-40ab-5cdd-804d-90031e1efb58_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/2b/3d2b37a76e11781e42434b3d20fc4334/pa/NB70789_65b03ff01bded5010b249da968774b84.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-10-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X4 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB70789%27 HTTP/1.1" 200 None
2026-03-28 12:06:51 [auto1.it] INFO: Saving data for NB70789: {'created_time': 1774699611.989132, 'last_price_update_time': 1774699611.989142, 'auction_closing_time': 1774884995.0}
2026-03-28 12:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NB70789') HTTP/1.1" 204 0
2026-03-28 12:06:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1e7dcd7d-102b-5040-8b00-8247980db4a5 with identifier: UD61440
2026-03-28 12:06:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1e7dcd7d-102b-5040-8b00-8247980db4a5 with identifier: UD61440
2026-03-28 12:06:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1e7dcd7d-102b-5040-8b00-8247980db4a5 with identifier: UD61440 to the API
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img38/71/38714f399d6082d8bc2c51d42dd3222e/pa/UD61440_dc4ddbcc30a748bbcc271afc646dee5a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 182,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:00:02Z',
 'fuel_type': 'diesel',
 'id': '1e7dcd7d-102b-5040-8b00-8247980db4a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD61440',
 'listing': 'auction',
 'location': 'IT, Perugia',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 448237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e7dcd7d-102b-5040-8b00-8247980db4a5/1e7dcd7d-102b-5040-8b00-8247980db4a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/71/38714f399d6082d8bc2c51d42dd3222e/pa/UD61440_81cf65da4b5f51c02983983b42a783f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e7dcd7d-102b-5040-8b00-8247980db4a5/1e7dcd7d-102b-5040-8b00-8247980db4a5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78370,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/71/38714f399d6082d8bc2c51d42dd3222e/pa/UD61440_a5fc91d9fcb73eb198ffd83a5929a965.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e7dcd7d-102b-5040-8b00-8247980db4a5/1e7dcd7d-102b-5040-8b00-8247980db4a5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/71/38714f399d6082d8bc2c51d42dd3222e/pa/UD61440_bc4d2eeda4e5578c7c421f0b7a30f7c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e7dcd7d-102b-5040-8b00-8247980db4a5/1e7dcd7d-102b-5040-8b00-8247980db4a5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/71/38714f399d6082d8bc2c51d42dd3222e/pa/UD61440_dc4ddbcc30a748bbcc271afc646dee5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e7dcd7d-102b-5040-8b00-8247980db4a5/1e7dcd7d-102b-5040-8b00-8247980db4a5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/71/38714f399d6082d8bc2c51d42dd3222e/pa/UD61440_cc7395fc145f791a2d5435254a831dea.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-01-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion',
 'transmission': 'manual',
 'trim': 'Sport & Style 4Motion',
 'year': 2009}
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD61440%27 HTTP/1.1" 200 None
2026-03-28 12:06:52 [auto1.it] INFO: Saving data for UD61440: {'created_time': 1774699612.32968, 'last_price_update_time': 1774699612.329694, 'auction_closing_time': 1774882802.0}
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UD61440') HTTP/1.1" 204 0
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F71%252F397150a64bdccd102587a586d843212d%252Fpa%252FLB50046_b5c9370d08a60b4dc3fd2cf3d84a43e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_b5c9370d08a60b4dc3fd2cf3d84a43e3.jpg not downloaded yet
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fbd%252F47bd971ee1470faa6c9f180bf82f1033%252Fpa%252FBC13106_149136a512bbbf057aa0ff291d564580.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/bd/47bd971ee1470faa6c9f180bf82f1033/pa/BC13106_149136a512bbbf057aa0ff291d564580.jpg not downloaded yet
2026-03-28 12:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_1bb722825f07b55986eda87c73fc9fd0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_70fc30230bb45b0e1bc48f0c4d1ba9b2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_5a013466b2cc6e10b9d98dce6f70673e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_233d28178b1ec672dd965ad339c6611d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_851621c89225a949e056a892b754e97d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VB56015> (referer: https://www.auto1.com/v1/car-details-view/VB56015/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd1650d0>
2026-03-28 12:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbdc37d8-83c1-576e-9ad5-1a040d503d19/dbdc37d8-83c1-576e-9ad5-1a040d503d19_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F48%252Fe248c720aeed58ebc8ade453fc6cd2e3%252Fpa%252FGD51545_14a877021f29bf6696cf19e9e10bc575.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_14a877021f29bf6696cf19e9e10bc575.jpg saved to cache
2026-03-28 12:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dbdc37d8-83c1-576e-9ad5-1a040d503d19
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F71%252F397150a64bdccd102587a586d843212d%252Fpa%252FLB50046_86cb860455a5c9a865932cccb7d121dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_86cb860455a5c9a865932cccb7d121dc.jpg not downloaded yet
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fbd%252F47bd971ee1470faa6c9f180bf82f1033%252Fpa%252FBC13106_3ccb5a2c5386c48f8d975f87e61bad38.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/bd/47bd971ee1470faa6c9f180bf82f1033/pa/BC13106_3ccb5a2c5386c48f8d975f87e61bad38.jpg not downloaded yet
2026-03-28 12:06:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F71%252F397150a64bdccd102587a586d843212d%252Fpa%252FLB50046_5b335238ceeaa33d257bd846c3ff8430.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_5b335238ceeaa33d257bd846c3ff8430.jpg not downloaded yet
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fbd%252F47bd971ee1470faa6c9f180bf82f1033%252Fpa%252FBC13106_33d51d2ea03afa51dc284fb6fc1f68f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/bd/47bd971ee1470faa6c9f180bf82f1033/pa/BC13106_33d51d2ea03afa51dc284fb6fc1f68f1.jpg not downloaded yet
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F71%252F397150a64bdccd102587a586d843212d%252Fpa%252FLB50046_f47dbef26925a37a13d7846374e89b3c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_f47dbef26925a37a13d7846374e89b3c.jpg not downloaded yet
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fbd%252F47bd971ee1470faa6c9f180bf82f1033%252Fpa%252FBC13106_cc45d72bbf72351d4a914794b1d86c34.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/bd/47bd971ee1470faa6c9f180bf82f1033/pa/BC13106_cc45d72bbf72351d4a914794b1d86c34.jpg not downloaded yet
2026-03-28 12:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_8b3de6bca8f857187bb4fe2e451f28e9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F71%252F397150a64bdccd102587a586d843212d%252Fpa%252FLB50046_26e4d51ed88144e09b9a98aca7a141dd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_26e4d51ed88144e09b9a98aca7a141dd.jpg not downloaded yet
2026-03-28 12:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/bd/47bd971ee1470faa6c9f180bf82f1033/pa/BC13106_f4f5572edb3c85ef9635a2d42d154dc9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_0bd7310beaf2ff95d339a4619249b827.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf36290>
2026-03-28 12:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbdc37d8-83c1-576e-9ad5-1a040d503d19/dbdc37d8-83c1-576e-9ad5-1a040d503d19_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F48%252Fe248c720aeed58ebc8ade453fc6cd2e3%252Fpa%252FGD51545_1bb722825f07b55986eda87c73fc9fd0.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_1bb722825f07b55986eda87c73fc9fd0.jpg saved to cache
2026-03-28 12:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dbdc37d8-83c1-576e-9ad5-1a040d503d19
2026-03-28 12:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc647850>
2026-03-28 12:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbdc37d8-83c1-576e-9ad5-1a040d503d19/dbdc37d8-83c1-576e-9ad5-1a040d503d19_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F48%252Fe248c720aeed58ebc8ade453fc6cd2e3%252Fpa%252FGD51545_70fc30230bb45b0e1bc48f0c4d1ba9b2.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_70fc30230bb45b0e1bc48f0c4d1ba9b2.jpg saved to cache
2026-03-28 12:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dbdc37d8-83c1-576e-9ad5-1a040d503d19
2026-03-28 12:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc275290>
2026-03-28 12:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fdd%252F71ddf47d2f6b29b49fdb4501aab760e2%252Fpa%252FPK33610_5a013466b2cc6e10b9d98dce6f70673e.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_5a013466b2cc6e10b9d98dce6f70673e.jpg saved to cache
2026-03-28 12:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3652c92f-d6ed-5635-a482-c31d8f9fc39d
2026-03-28 12:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc646490>
2026-03-28 12:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fdd%252F71ddf47d2f6b29b49fdb4501aab760e2%252Fpa%252FPK33610_233d28178b1ec672dd965ad339c6611d.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_233d28178b1ec672dd965ad339c6611d.jpg saved to cache
2026-03-28 12:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3652c92f-d6ed-5635-a482-c31d8f9fc39d
2026-03-28 12:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc613350>
2026-03-28 12:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbdc37d8-83c1-576e-9ad5-1a040d503d19/dbdc37d8-83c1-576e-9ad5-1a040d503d19_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F48%252Fe248c720aeed58ebc8ade453fc6cd2e3%252Fpa%252FGD51545_851621c89225a949e056a892b754e97d.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_851621c89225a949e056a892b754e97d.jpg saved to cache
2026-03-28 12:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dbdc37d8-83c1-576e-9ad5-1a040d503d19
2026-03-28 12:06:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dbdc37d8-83c1-576e-9ad5-1a040d503d19, skipping ID generation
2026-03-28 12:06:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbdc37d8-83c1-576e-9ad5-1a040d503d19 with scrape type 1
2026-03-28 12:06:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dbdc37d8-83c1-576e-9ad5-1a040d503d19 sending to next pipeline
2026-03-28 12:06:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dbdc37d8-83c1-576e-9ad5-1a040d503d19, identifier: GD51545
2026-03-28 12:06:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87a43274-98c5-525d-99d7-bd65dbd988d3 with identifier: VB56015
2026-03-28 12:06:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87a43274-98c5-525d-99d7-bd65dbd988d3 with scrape type 1
2026-03-28 12:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 87a43274-98c5-525d-99d7-bd65dbd988d3
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F3d%252Fad3d95af6de154b8962720c4d301132d%252Fpa%252FVB56015_bf623c1cabf79cef7af521afe20e86fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_bf623c1cabf79cef7af521afe20e86fd.jpg not downloaded yet
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F71%252F397150a64bdccd102587a586d843212d%252Fpa%252FLB50046_f5c2eeedf1493ec4ce2dc2ca7cc93266.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_f5c2eeedf1493ec4ce2dc2ca7cc93266.jpg not downloaded yet
2026-03-28 12:06:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dbdc37d8-83c1-576e-9ad5-1a040d503d19 with identifier: GD51545
2026-03-28 12:06:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dbdc37d8-83c1-576e-9ad5-1a040d503d19 with identifier: GD51545
2026-03-28 12:06:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dbdc37d8-83c1-576e-9ad5-1a040d503d19 with identifier: GD51545 to the API
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_851621c89225a949e056a892b754e97d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:41:29Z',
 'fuel_type': 'petrol',
 'id': 'dbdc37d8-83c1-576e-9ad5-1a040d503d19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD51545',
 'listing': 'auction',
 'location': 'IT, Palermo',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 101688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbdc37d8-83c1-576e-9ad5-1a040d503d19/dbdc37d8-83c1-576e-9ad5-1a040d503d19_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_70fc30230bb45b0e1bc48f0c4d1ba9b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbdc37d8-83c1-576e-9ad5-1a040d503d19/dbdc37d8-83c1-576e-9ad5-1a040d503d19_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_851621c89225a949e056a892b754e97d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbdc37d8-83c1-576e-9ad5-1a040d503d19/dbdc37d8-83c1-576e-9ad5-1a040d503d19_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_1bb722825f07b55986eda87c73fc9fd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbdc37d8-83c1-576e-9ad5-1a040d503d19/dbdc37d8-83c1-576e-9ad5-1a040d503d19_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_14a877021f29bf6696cf19e9e10bc575.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbdc37d8-83c1-576e-9ad5-1a040d503d19/dbdc37d8-83c1-576e-9ad5-1a040d503d19_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_94e0cfed955db6590b20a7e13ac2e6d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbdc37d8-83c1-576e-9ad5-1a040d503d19/dbdc37d8-83c1-576e-9ad5-1a040d503d19_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_a2725a3a1cdb955e7e27c1e99ee45877.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbdc37d8-83c1-576e-9ad5-1a040d503d19/dbdc37d8-83c1-576e-9ad5-1a040d503d19_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_248ffe7e2f3581d379d161e76668c3c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbdc37d8-83c1-576e-9ad5-1a040d503d19/dbdc37d8-83c1-576e-9ad5-1a040d503d19_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_e6a6ba99cdb69cee6ef8d3423d6fd0a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbdc37d8-83c1-576e-9ad5-1a040d503d19/dbdc37d8-83c1-576e-9ad5-1a040d503d19_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_3b62322d23d7b2878eeb5d8ac3d6782a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbdc37d8-83c1-576e-9ad5-1a040d503d19/dbdc37d8-83c1-576e-9ad5-1a040d503d19_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/48/e248c720aeed58ebc8ade453fc6cd2e3/pa/GD51545_50ed819ffdc8243ae6468ec1ce5c9f92.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD51545%27 HTTP/1.1" 200 None
2026-03-28 12:06:53 [auto1.it] INFO: Saving data for GD51545: {'created_time': 1774699613.468194, 'last_price_update_time': 1774699613.468204, 'auction_closing_time': 1774885289.0}
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GD51545') HTTP/1.1" 204 0
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F3d%252Fad3d95af6de154b8962720c4d301132d%252Fpa%252FVB56015_6191d1d2f672fc2b432d70eeb278f1ee.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_6191d1d2f672fc2b432d70eeb278f1ee.jpg not downloaded yet
2026-03-28 12:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_e9bcbf2befff65ec598b3be77179e673.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/bd/47bd971ee1470faa6c9f180bf82f1033/pa/BC13106_149136a512bbbf057aa0ff291d564580.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F71%252F397150a64bdccd102587a586d843212d%252Fpa%252FLB50046_e1c1e29b8c966247e4cf6787e0179d7d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_e1c1e29b8c966247e4cf6787e0179d7d.jpg not downloaded yet
2026-03-28 12:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LU93439> (referer: https://www.auto1.com/v1/car-details-view/LU93439/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc390850>
2026-03-28 12:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d9f1cd-13c8-5a12-a075-fc1c6be123f9/03d9f1cd-13c8-5a12-a075-fc1c6be123f9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F71%252F397150a64bdccd102587a586d843212d%252Fpa%252FLB50046_8b3de6bca8f857187bb4fe2e451f28e9.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_8b3de6bca8f857187bb4fe2e451f28e9.jpg saved to cache
2026-03-28 12:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 03d9f1cd-13c8-5a12-a075-fc1c6be123f9
2026-03-28 12:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc381b50>
2026-03-28 12:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36ce2ae7-4284-57be-bf98-6054721a526e/36ce2ae7-4284-57be-bf98-6054721a526e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fbd%252F47bd971ee1470faa6c9f180bf82f1033%252Fpa%252FBC13106_f4f5572edb3c85ef9635a2d42d154dc9.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/bd/47bd971ee1470faa6c9f180bf82f1033/pa/BC13106_f4f5572edb3c85ef9635a2d42d154dc9.jpg saved to cache
2026-03-28 12:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36ce2ae7-4284-57be-bf98-6054721a526e
2026-03-28 12:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcec8a90>
2026-03-28 12:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fdd%252F71ddf47d2f6b29b49fdb4501aab760e2%252Fpa%252FPK33610_0bd7310beaf2ff95d339a4619249b827.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_0bd7310beaf2ff95d339a4619249b827.jpg saved to cache
2026-03-28 12:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3652c92f-d6ed-5635-a482-c31d8f9fc39d
2026-03-28 12:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_f47dbef26925a37a13d7846374e89b3c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F3d%252Fad3d95af6de154b8962720c4d301132d%252Fpa%252FVB56015_7bc4f44d357247a962f5a1bf89fb2b33.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_7bc4f44d357247a962f5a1bf89fb2b33.jpg not downloaded yet
2026-03-28 12:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SD66994/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LD34697> (referer: https://www.auto1.com/v1/car-details-view/LD34697/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WG00273> (referer: https://www.auto1.com/v1/car-details-view/WG00273/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VK29965/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MX93098/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F71%252F397150a64bdccd102587a586d843212d%252Fpa%252FLB50046_a29c70ba3cbc59ecbcd3ade34b6fd773.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_a29c70ba3cbc59ecbcd3ade34b6fd773.jpg not downloaded yet
2026-03-28 12:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/bd/47bd971ee1470faa6c9f180bf82f1033/pa/BC13106_cc45d72bbf72351d4a914794b1d86c34.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F3d%252Fad3d95af6de154b8962720c4d301132d%252Fpa%252FVB56015_0d2c0ed4c1664d815df281bc25bf576c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_0d2c0ed4c1664d815df281bc25bf576c.jpg not downloaded yet
2026-03-28 12:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bef357d0>
2026-03-28 12:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414ee5a8-9966-5155-a7ea-6743de9d969e/414ee5a8-9966-5155-a7ea-6743de9d969e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F4f%252Fb04fe85e59a6f1572dcd7cea19f81faa%252Fpa%252FEG76959_e9bcbf2befff65ec598b3be77179e673.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_e9bcbf2befff65ec598b3be77179e673.jpg saved to cache
2026-03-28 12:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 414ee5a8-9966-5155-a7ea-6743de9d969e
2026-03-28 12:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd015290>
2026-03-28 12:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36ce2ae7-4284-57be-bf98-6054721a526e/36ce2ae7-4284-57be-bf98-6054721a526e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fbd%252F47bd971ee1470faa6c9f180bf82f1033%252Fpa%252FBC13106_149136a512bbbf057aa0ff291d564580.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/bd/47bd971ee1470faa6c9f180bf82f1033/pa/BC13106_149136a512bbbf057aa0ff291d564580.jpg saved to cache
2026-03-28 12:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 36ce2ae7-4284-57be-bf98-6054721a526e
2026-03-28 12:06:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f5b67b1-8b62-508a-bcb7-c0e377fb8051 with identifier: LU93439
2026-03-28 12:06:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f5b67b1-8b62-508a-bcb7-c0e377fb8051 with scrape type 1
2026-03-28 12:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 9f5b67b1-8b62-508a-bcb7-c0e377fb8051
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F12%252F2e12f5a3f023fa9981034a9ff6c5df01%252Fpa%252FLU93439_4fa6e8e946961aaf81c29ffe57348b6b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/12/2e12f5a3f023fa9981034a9ff6c5df01/pa/LU93439_4fa6e8e946961aaf81c29ffe57348b6b.jpg not downloaded yet
2026-03-28 12:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/bd/47bd971ee1470faa6c9f180bf82f1033/pa/BC13106_33d51d2ea03afa51dc284fb6fc1f68f1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F71%252F397150a64bdccd102587a586d843212d%252Fpa%252FLB50046_95f311b1bace6e962250ebd8f1e26707.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_95f311b1bace6e962250ebd8f1e26707.jpg not downloaded yet
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F3d%252Fad3d95af6de154b8962720c4d301132d%252Fpa%252FVB56015_0e86faf231ddf8ba4ac91b0e47136111.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_0e86faf231ddf8ba4ac91b0e47136111.jpg not downloaded yet
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F12%252F2e12f5a3f023fa9981034a9ff6c5df01%252Fpa%252FLU93439_06108f3d79fe345efde910f5d5f61696.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/12/2e12f5a3f023fa9981034a9ff6c5df01/pa/LU93439_06108f3d79fe345efde910f5d5f61696.jpg not downloaded yet
2026-03-28 12:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_f5c2eeedf1493ec4ce2dc2ca7cc93266.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_6191d1d2f672fc2b432d70eeb278f1ee.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_bf623c1cabf79cef7af521afe20e86fd.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F3d%252Fad3d95af6de154b8962720c4d301132d%252Fpa%252FVB56015_3cf59c87ebeecc88c4f5122cee3998dd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_3cf59c87ebeecc88c4f5122cee3998dd.jpg not downloaded yet
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F12%252F2e12f5a3f023fa9981034a9ff6c5df01%252Fpa%252FLU93439_5a84f3773c40072c79709dc77ad0599e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/12/2e12f5a3f023fa9981034a9ff6c5df01/pa/LU93439_5a84f3773c40072c79709dc77ad0599e.jpg not downloaded yet
2026-03-28 12:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_26e4d51ed88144e09b9a98aca7a141dd.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bf1b9ad0>
2026-03-28 12:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d9f1cd-13c8-5a12-a075-fc1c6be123f9/03d9f1cd-13c8-5a12-a075-fc1c6be123f9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F71%252F397150a64bdccd102587a586d843212d%252Fpa%252FLB50046_f47dbef26925a37a13d7846374e89b3c.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_f47dbef26925a37a13d7846374e89b3c.jpg saved to cache
2026-03-28 12:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 03d9f1cd-13c8-5a12-a075-fc1c6be123f9
2026-03-28 12:06:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dba344c-9659-55ab-b03c-647479a30b0f with identifier: LD34697
2026-03-28 12:06:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dba344c-9659-55ab-b03c-647479a30b0f with scrape type 1
2026-03-28 12:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5dba344c-9659-55ab-b03c-647479a30b0f
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe0%252F71e02bbca5e8df98969c4264b7c1975a%252Fpa%252FLD34697_1b03942475310d056d482267c7a7f1db.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_1b03942475310d056d482267c7a7f1db.jpg not downloaded yet
2026-03-28 12:06:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6896d477-cffe-57f4-8204-fba01dc762e5 with identifier: WG00273
2026-03-28 12:06:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6896d477-cffe-57f4-8204-fba01dc762e5 with scrape type 1
2026-03-28 12:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 6896d477-cffe-57f4-8204-fba01dc762e5
2026-03-28 12:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F59%252F2759fedf1003bfacfe14dabf1bddfa9b%252Fpa%252FWG00273_a318360e6a78097650201f90889b396d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/59/2759fedf1003bfacfe14dabf1bddfa9b/pa/WG00273_a318360e6a78097650201f90889b396d.jpg not downloaded yet
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd0f0850>
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36ce2ae7-4284-57be-bf98-6054721a526e/36ce2ae7-4284-57be-bf98-6054721a526e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fbd%252F47bd971ee1470faa6c9f180bf82f1033%252Fpa%252FBC13106_cc45d72bbf72351d4a914794b1d86c34.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/bd/47bd971ee1470faa6c9f180bf82f1033/pa/BC13106_cc45d72bbf72351d4a914794b1d86c34.jpg saved to cache
2026-03-28 12:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 36ce2ae7-4284-57be-bf98-6054721a526e
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F3d%252Fad3d95af6de154b8962720c4d301132d%252Fpa%252FVB56015_828cda41160f2c130143e1e45ce32994.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_828cda41160f2c130143e1e45ce32994.jpg not downloaded yet
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F12%252F2e12f5a3f023fa9981034a9ff6c5df01%252Fpa%252FLU93439_4e75f4447406f3e743645fb8854ed4ee.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/12/2e12f5a3f023fa9981034a9ff6c5df01/pa/LU93439_4e75f4447406f3e743645fb8854ed4ee.jpg not downloaded yet
2026-03-28 12:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/bd/47bd971ee1470faa6c9f180bf82f1033/pa/BC13106_3ccb5a2c5386c48f8d975f87e61bad38.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe0%252F71e02bbca5e8df98969c4264b7c1975a%252Fpa%252FLD34697_cee7b9a1537bc5b6701dc74e3a23bc9c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_cee7b9a1537bc5b6701dc74e3a23bc9c.jpg not downloaded yet
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F59%252F2759fedf1003bfacfe14dabf1bddfa9b%252Fpa%252FWG00273_44f6d911a60fc13eaf250de92b5b1a0f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/59/2759fedf1003bfacfe14dabf1bddfa9b/pa/WG00273_44f6d911a60fc13eaf250de92b5b1a0f.jpg not downloaded yet
2026-03-28 12:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_5b335238ceeaa33d257bd846c3ff8430.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_e1c1e29b8c966247e4cf6787e0179d7d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F3d%252Fad3d95af6de154b8962720c4d301132d%252Fpa%252FVB56015_43a7819e90743a68e723834729b35d12.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_43a7819e90743a68e723834729b35d12.jpg not downloaded yet
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F12%252F2e12f5a3f023fa9981034a9ff6c5df01%252Fpa%252FLU93439_da9546644830d9e5890d6cfe7d745276.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/12/2e12f5a3f023fa9981034a9ff6c5df01/pa/LU93439_da9546644830d9e5890d6cfe7d745276.jpg not downloaded yet
2026-03-28 12:06:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3b7fd0>
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36ce2ae7-4284-57be-bf98-6054721a526e/36ce2ae7-4284-57be-bf98-6054721a526e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fbd%252F47bd971ee1470faa6c9f180bf82f1033%252Fpa%252FBC13106_33d51d2ea03afa51dc284fb6fc1f68f1.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/bd/47bd971ee1470faa6c9f180bf82f1033/pa/BC13106_33d51d2ea03afa51dc284fb6fc1f68f1.jpg saved to cache
2026-03-28 12:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 36ce2ae7-4284-57be-bf98-6054721a526e
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd1647d0>
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d9f1cd-13c8-5a12-a075-fc1c6be123f9/03d9f1cd-13c8-5a12-a075-fc1c6be123f9_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F71%252F397150a64bdccd102587a586d843212d%252Fpa%252FLB50046_f5c2eeedf1493ec4ce2dc2ca7cc93266.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_f5c2eeedf1493ec4ce2dc2ca7cc93266.jpg saved to cache
2026-03-28 12:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 03d9f1cd-13c8-5a12-a075-fc1c6be123f9
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04beec5d10>
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87a43274-98c5-525d-99d7-bd65dbd988d3/87a43274-98c5-525d-99d7-bd65dbd988d3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F3d%252Fad3d95af6de154b8962720c4d301132d%252Fpa%252FVB56015_6191d1d2f672fc2b432d70eeb278f1ee.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_6191d1d2f672fc2b432d70eeb278f1ee.jpg saved to cache
2026-03-28 12:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 87a43274-98c5-525d-99d7-bd65dbd988d3
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd166cd0>
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87a43274-98c5-525d-99d7-bd65dbd988d3/87a43274-98c5-525d-99d7-bd65dbd988d3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F3d%252Fad3d95af6de154b8962720c4d301132d%252Fpa%252FVB56015_bf623c1cabf79cef7af521afe20e86fd.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_bf623c1cabf79cef7af521afe20e86fd.jpg saved to cache
2026-03-28 12:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 87a43274-98c5-525d-99d7-bd65dbd988d3
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bf6d38d0>
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d9f1cd-13c8-5a12-a075-fc1c6be123f9/03d9f1cd-13c8-5a12-a075-fc1c6be123f9_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F71%252F397150a64bdccd102587a586d843212d%252Fpa%252FLB50046_26e4d51ed88144e09b9a98aca7a141dd.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_26e4d51ed88144e09b9a98aca7a141dd.jpg saved to cache
2026-03-28 12:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 03d9f1cd-13c8-5a12-a075-fc1c6be123f9
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe0%252F71e02bbca5e8df98969c4264b7c1975a%252Fpa%252FLD34697_56eeece0d0ca71e96f541b404e44174a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_56eeece0d0ca71e96f541b404e44174a.jpg not downloaded yet
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F59%252F2759fedf1003bfacfe14dabf1bddfa9b%252Fpa%252FWG00273_fe6569448b0891abaad03e7034169327.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/59/2759fedf1003bfacfe14dabf1bddfa9b/pa/WG00273_fe6569448b0891abaad03e7034169327.jpg not downloaded yet
2026-03-28 12:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_86cb860455a5c9a865932cccb7d121dc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_b5c9370d08a60b4dc3fd2cf3d84a43e3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F3d%252Fad3d95af6de154b8962720c4d301132d%252Fpa%252FVB56015_2a7c273599bf4016ce11e4fe77db6f11.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_2a7c273599bf4016ce11e4fe77db6f11.jpg not downloaded yet
2026-03-28 12:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_7bc4f44d357247a962f5a1bf89fb2b33.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe0%252F71e02bbca5e8df98969c4264b7c1975a%252Fpa%252FLD34697_b3fd0529a5c85ce493aede5f40870682.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_b3fd0529a5c85ce493aede5f40870682.jpg not downloaded yet
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F59%252F2759fedf1003bfacfe14dabf1bddfa9b%252Fpa%252FWG00273_d1fb00caed01b721a855ff4705f44116.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/59/2759fedf1003bfacfe14dabf1bddfa9b/pa/WG00273_d1fb00caed01b721a855ff4705f44116.jpg not downloaded yet
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3c3690>
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36ce2ae7-4284-57be-bf98-6054721a526e/36ce2ae7-4284-57be-bf98-6054721a526e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fbd%252F47bd971ee1470faa6c9f180bf82f1033%252Fpa%252FBC13106_3ccb5a2c5386c48f8d975f87e61bad38.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/bd/47bd971ee1470faa6c9f180bf82f1033/pa/BC13106_3ccb5a2c5386c48f8d975f87e61bad38.jpg saved to cache
2026-03-28 12:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 36ce2ae7-4284-57be-bf98-6054721a526e
2026-03-28 12:06:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36ce2ae7-4284-57be-bf98-6054721a526e, skipping ID generation
2026-03-28 12:06:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36ce2ae7-4284-57be-bf98-6054721a526e with scrape type 1
2026-03-28 12:06:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36ce2ae7-4284-57be-bf98-6054721a526e sending to next pipeline
2026-03-28 12:06:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 36ce2ae7-4284-57be-bf98-6054721a526e, identifier: BC13106
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3b0410>
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d9f1cd-13c8-5a12-a075-fc1c6be123f9/03d9f1cd-13c8-5a12-a075-fc1c6be123f9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F71%252F397150a64bdccd102587a586d843212d%252Fpa%252FLB50046_5b335238ceeaa33d257bd846c3ff8430.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_5b335238ceeaa33d257bd846c3ff8430.jpg saved to cache
2026-03-28 12:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 03d9f1cd-13c8-5a12-a075-fc1c6be123f9
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3d60d0>
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d9f1cd-13c8-5a12-a075-fc1c6be123f9/03d9f1cd-13c8-5a12-a075-fc1c6be123f9_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F71%252F397150a64bdccd102587a586d843212d%252Fpa%252FLB50046_e1c1e29b8c966247e4cf6787e0179d7d.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_e1c1e29b8c966247e4cf6787e0179d7d.jpg saved to cache
2026-03-28 12:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 03d9f1cd-13c8-5a12-a075-fc1c6be123f9
2026-03-28 12:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/12/2e12f5a3f023fa9981034a9ff6c5df01/pa/LU93439_4fa6e8e946961aaf81c29ffe57348b6b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F3d%252Fad3d95af6de154b8962720c4d301132d%252Fpa%252FVB56015_48f1748b344f23965a21ba160c5bb450.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_48f1748b344f23965a21ba160c5bb450.jpg not downloaded yet
2026-03-28 12:06:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 36ce2ae7-4284-57be-bf98-6054721a526e with identifier: BC13106
2026-03-28 12:06:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 36ce2ae7-4284-57be-bf98-6054721a526e with identifier: BC13106
2026-03-28 12:06:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 36ce2ae7-4284-57be-bf98-6054721a526e with identifier: BC13106 to the API
2026-03-28 12:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img47/bd/47bd971ee1470faa6c9f180bf82f1033/pa/BC13106_3ccb5a2c5386c48f8d975f87e61bad38.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:19:43Z',
 'fuel_type': 'petrol',
 'id': '36ce2ae7-4284-57be-bf98-6054721a526e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC13106',
 'listing': 'auction',
 'location': 'IT, Venezia',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 128598,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36ce2ae7-4284-57be-bf98-6054721a526e/36ce2ae7-4284-57be-bf98-6054721a526e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80769,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/bd/47bd971ee1470faa6c9f180bf82f1033/pa/BC13106_f4f5572edb3c85ef9635a2d42d154dc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36ce2ae7-4284-57be-bf98-6054721a526e/36ce2ae7-4284-57be-bf98-6054721a526e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78185,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/bd/47bd971ee1470faa6c9f180bf82f1033/pa/BC13106_149136a512bbbf057aa0ff291d564580.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36ce2ae7-4284-57be-bf98-6054721a526e/36ce2ae7-4284-57be-bf98-6054721a526e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/bd/47bd971ee1470faa6c9f180bf82f1033/pa/BC13106_3ccb5a2c5386c48f8d975f87e61bad38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36ce2ae7-4284-57be-bf98-6054721a526e/36ce2ae7-4284-57be-bf98-6054721a526e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/bd/47bd971ee1470faa6c9f180bf82f1033/pa/BC13106_33d51d2ea03afa51dc284fb6fc1f68f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36ce2ae7-4284-57be-bf98-6054721a526e/36ce2ae7-4284-57be-bf98-6054721a526e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/bd/47bd971ee1470faa6c9f180bf82f1033/pa/BC13106_cc45d72bbf72351d4a914794b1d86c34.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-09-29',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Opel Zafira 1.6 Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2010}
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BC13106%27 HTTP/1.1" 200 None
2026-03-28 12:06:55 [auto1.it] INFO: Saving data for BC13106: {'created_time': 1774699615.21616, 'last_price_update_time': 1774699615.216171, 'auction_closing_time': 1774883983.0}
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BC13106') HTTP/1.1" 204 0
2026-03-28 12:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/12/2e12f5a3f023fa9981034a9ff6c5df01/pa/LU93439_06108f3d79fe345efde910f5d5f61696.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_95f311b1bace6e962250ebd8f1e26707.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_0d2c0ed4c1664d815df281bc25bf576c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe0%252F71e02bbca5e8df98969c4264b7c1975a%252Fpa%252FLD34697_da79cf1e646b9bb44f3cc1c3d10198de.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_da79cf1e646b9bb44f3cc1c3d10198de.jpg not downloaded yet
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F59%252F2759fedf1003bfacfe14dabf1bddfa9b%252Fpa%252FWG00273_57ff5e2e827a5dadaa50c376bc69bcac.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/59/2759fedf1003bfacfe14dabf1bddfa9b/pa/WG00273_57ff5e2e827a5dadaa50c376bc69bcac.jpg not downloaded yet
2026-03-28 12:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_0e86faf231ddf8ba4ac91b0e47136111.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SS75136/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe0%252F71e02bbca5e8df98969c4264b7c1975a%252Fpa%252FLD34697_2cb744cec3cdaa5e02493ff71a036db1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_2cb744cec3cdaa5e02493ff71a036db1.jpg not downloaded yet
2026-03-28 12:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_5479cdfcc82fc8b22a6ea9a4cbb0199d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcebf8d0>
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d9f1cd-13c8-5a12-a075-fc1c6be123f9/03d9f1cd-13c8-5a12-a075-fc1c6be123f9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F71%252F397150a64bdccd102587a586d843212d%252Fpa%252FLB50046_86cb860455a5c9a865932cccb7d121dc.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_86cb860455a5c9a865932cccb7d121dc.jpg saved to cache
2026-03-28 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 03d9f1cd-13c8-5a12-a075-fc1c6be123f9
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5c9450>
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d9f1cd-13c8-5a12-a075-fc1c6be123f9/03d9f1cd-13c8-5a12-a075-fc1c6be123f9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F71%252F397150a64bdccd102587a586d843212d%252Fpa%252FLB50046_b5c9370d08a60b4dc3fd2cf3d84a43e3.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_b5c9370d08a60b4dc3fd2cf3d84a43e3.jpg saved to cache
2026-03-28 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 03d9f1cd-13c8-5a12-a075-fc1c6be123f9
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc60ac90>
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87a43274-98c5-525d-99d7-bd65dbd988d3/87a43274-98c5-525d-99d7-bd65dbd988d3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F3d%252Fad3d95af6de154b8962720c4d301132d%252Fpa%252FVB56015_7bc4f44d357247a962f5a1bf89fb2b33.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_7bc4f44d357247a962f5a1bf89fb2b33.jpg saved to cache
2026-03-28 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 87a43274-98c5-525d-99d7-bd65dbd988d3
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc2e0dd0>
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f5b67b1-8b62-508a-bcb7-c0e377fb8051/9f5b67b1-8b62-508a-bcb7-c0e377fb8051_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F12%252F2e12f5a3f023fa9981034a9ff6c5df01%252Fpa%252FLU93439_4fa6e8e946961aaf81c29ffe57348b6b.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/12/2e12f5a3f023fa9981034a9ff6c5df01/pa/LU93439_4fa6e8e946961aaf81c29ffe57348b6b.jpg saved to cache
2026-03-28 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f5b67b1-8b62-508a-bcb7-c0e377fb8051
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe0%252F71e02bbca5e8df98969c4264b7c1975a%252Fpa%252FLD34697_2d076204ef391cdd35ae319cf094b2a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_2d076204ef391cdd35ae319cf094b2a4.jpg not downloaded yet
2026-03-28 12:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/59/2759fedf1003bfacfe14dabf1bddfa9b/pa/WG00273_fe6569448b0891abaad03e7034169327.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_828cda41160f2c130143e1e45ce32994.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/12/2e12f5a3f023fa9981034a9ff6c5df01/pa/LU93439_4e75f4447406f3e743645fb8854ed4ee.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_a21e10280aabaaba4484f3a798107a6b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_43a7819e90743a68e723834729b35d12.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/12/2e12f5a3f023fa9981034a9ff6c5df01/pa/LU93439_da9546644830d9e5890d6cfe7d745276.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe0%252F71e02bbca5e8df98969c4264b7c1975a%252Fpa%252FLD34697_e69c8ef70f7ad1b3b9a3c662dd27d15b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_e69c8ef70f7ad1b3b9a3c662dd27d15b.jpg not downloaded yet
2026-03-28 12:06:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfbfc10>
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f5b67b1-8b62-508a-bcb7-c0e377fb8051/9f5b67b1-8b62-508a-bcb7-c0e377fb8051_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F12%252F2e12f5a3f023fa9981034a9ff6c5df01%252Fpa%252FLU93439_06108f3d79fe345efde910f5d5f61696.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/12/2e12f5a3f023fa9981034a9ff6c5df01/pa/LU93439_06108f3d79fe345efde910f5d5f61696.jpg saved to cache
2026-03-28 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9f5b67b1-8b62-508a-bcb7-c0e377fb8051
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bce8fa50>
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d9f1cd-13c8-5a12-a075-fc1c6be123f9/03d9f1cd-13c8-5a12-a075-fc1c6be123f9_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F71%252F397150a64bdccd102587a586d843212d%252Fpa%252FLB50046_95f311b1bace6e962250ebd8f1e26707.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_95f311b1bace6e962250ebd8f1e26707.jpg saved to cache
2026-03-28 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 03d9f1cd-13c8-5a12-a075-fc1c6be123f9
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc599b10>
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87a43274-98c5-525d-99d7-bd65dbd988d3/87a43274-98c5-525d-99d7-bd65dbd988d3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F3d%252Fad3d95af6de154b8962720c4d301132d%252Fpa%252FVB56015_0d2c0ed4c1664d815df281bc25bf576c.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_0d2c0ed4c1664d815df281bc25bf576c.jpg saved to cache
2026-03-28 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 87a43274-98c5-525d-99d7-bd65dbd988d3
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bce8ce90>
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87a43274-98c5-525d-99d7-bd65dbd988d3/87a43274-98c5-525d-99d7-bd65dbd988d3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F3d%252Fad3d95af6de154b8962720c4d301132d%252Fpa%252FVB56015_0e86faf231ddf8ba4ac91b0e47136111.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_0e86faf231ddf8ba4ac91b0e47136111.jpg saved to cache
2026-03-28 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 87a43274-98c5-525d-99d7-bd65dbd988d3
2026-03-28 12:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc65d810>
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_879e56cb-6dfd-584f-b307-a60aa53227cc/879e56cb-6dfd-584f-b307-a60aa53227cc_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F3e%252F153ee8bb06b005df8e199eafa507c95d%252Fpa%252FZX02617_5479cdfcc82fc8b22a6ea9a4cbb0199d.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_5479cdfcc82fc8b22a6ea9a4cbb0199d.jpg saved to cache
2026-03-28 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 879e56cb-6dfd-584f-b307-a60aa53227cc
2026-03-28 12:06:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 879e56cb-6dfd-584f-b307-a60aa53227cc, skipping ID generation
2026-03-28 12:06:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 879e56cb-6dfd-584f-b307-a60aa53227cc with scrape type 1
2026-03-28 12:06:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 879e56cb-6dfd-584f-b307-a60aa53227cc sending to next pipeline
2026-03-28 12:06:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 879e56cb-6dfd-584f-b307-a60aa53227cc, identifier: ZX02617
2026-03-28 12:06:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 879e56cb-6dfd-584f-b307-a60aa53227cc with identifier: ZX02617
2026-03-28 12:06:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 879e56cb-6dfd-584f-b307-a60aa53227cc with identifier: ZX02617
2026-03-28 12:06:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 879e56cb-6dfd-584f-b307-a60aa53227cc with identifier: ZX02617 to the API
2026-03-28 12:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_5479cdfcc82fc8b22a6ea9a4cbb0199d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:27:40Z',
 'fuel_type': 'diesel',
 'id': '879e56cb-6dfd-584f-b307-a60aa53227cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX02617',
 'listing': 'auction',
 'location': 'IT, Genova',
 'make': 'BMW',
 'model': '4er',
 'odometer': 142011,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_879e56cb-6dfd-584f-b307-a60aa53227cc/879e56cb-6dfd-584f-b307-a60aa53227cc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_2b4ef9c4a52b0aa40b1ae0d3ba978729.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_879e56cb-6dfd-584f-b307-a60aa53227cc/879e56cb-6dfd-584f-b307-a60aa53227cc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2121284,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_b9ed71b9ae047a96ac15ea8bd695f85b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_879e56cb-6dfd-584f-b307-a60aa53227cc/879e56cb-6dfd-584f-b307-a60aa53227cc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2128903,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_223b9d6602476e80d69fb80d5cc90ef5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_879e56cb-6dfd-584f-b307-a60aa53227cc/879e56cb-6dfd-584f-b307-a60aa53227cc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1944339,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_219d597003920f98cd7d74cc04c40605.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_879e56cb-6dfd-584f-b307-a60aa53227cc/879e56cb-6dfd-584f-b307-a60aa53227cc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2102500,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_4a1a75c8890480e0a2499a8efcc5182a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_879e56cb-6dfd-584f-b307-a60aa53227cc/879e56cb-6dfd-584f-b307-a60aa53227cc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2069515,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_5479cdfcc82fc8b22a6ea9a4cbb0199d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_879e56cb-6dfd-584f-b307-a60aa53227cc/879e56cb-6dfd-584f-b307-a60aa53227cc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_2ba2bc31dceac7e13eb54cd28211475d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_879e56cb-6dfd-584f-b307-a60aa53227cc/879e56cb-6dfd-584f-b307-a60aa53227cc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2013531,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_787e563be0507c190b87cbb80e17983a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_879e56cb-6dfd-584f-b307-a60aa53227cc/879e56cb-6dfd-584f-b307-a60aa53227cc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_e091bfd6fff1d53aea139d2924bafcc5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_879e56cb-6dfd-584f-b307-a60aa53227cc/879e56cb-6dfd-584f-b307-a60aa53227cc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/3e/153ee8bb06b005df8e199eafa507c95d/pa/ZX02617_108f33bca457f4f851776ae8d81c4968.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 4er 420d Gran Coupé M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2016}
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX02617%27 HTTP/1.1" 200 None
2026-03-28 12:06:56 [auto1.it] INFO: Saving data for ZX02617: {'created_time': 1774699616.288327, 'last_price_update_time': 1774699616.288337, 'auction_closing_time': 1774884460.0}
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZX02617') HTTP/1.1" 204 0
2026-03-28 12:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_2a7c273599bf4016ce11e4fe77db6f11.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_56eeece0d0ca71e96f541b404e44174a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe0%252F71e02bbca5e8df98969c4264b7c1975a%252Fpa%252FLD34697_2a9353e4e69516aca8a3d093566b1cfb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_2a9353e4e69516aca8a3d093566b1cfb.jpg not downloaded yet
2026-03-28 12:06:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_48f1748b344f23965a21ba160c5bb450.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_da79cf1e646b9bb44f3cc1c3d10198de.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/59/2759fedf1003bfacfe14dabf1bddfa9b/pa/WG00273_57ff5e2e827a5dadaa50c376bc69bcac.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/59/2759fedf1003bfacfe14dabf1bddfa9b/pa/WG00273_d1fb00caed01b721a855ff4705f44116.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe0%252F71e02bbca5e8df98969c4264b7c1975a%252Fpa%252FLD34697_e00a2930546a3b20a1d43de860b976e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_e00a2930546a3b20a1d43de860b976e8.jpg not downloaded yet
2026-03-28 12:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MX93098> (referer: https://www.auto1.com/v1/car-details-view/MX93098/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3a8d90>
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6896d477-cffe-57f4-8204-fba01dc762e5/6896d477-cffe-57f4-8204-fba01dc762e5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F59%252F2759fedf1003bfacfe14dabf1bddfa9b%252Fpa%252FWG00273_fe6569448b0891abaad03e7034169327.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/59/2759fedf1003bfacfe14dabf1bddfa9b/pa/WG00273_fe6569448b0891abaad03e7034169327.jpg saved to cache
2026-03-28 12:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6896d477-cffe-57f4-8204-fba01dc762e5
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc2d3f10>
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87a43274-98c5-525d-99d7-bd65dbd988d3/87a43274-98c5-525d-99d7-bd65dbd988d3_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F3d%252Fad3d95af6de154b8962720c4d301132d%252Fpa%252FVB56015_828cda41160f2c130143e1e45ce32994.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_828cda41160f2c130143e1e45ce32994.jpg saved to cache
2026-03-28 12:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 87a43274-98c5-525d-99d7-bd65dbd988d3
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf3ded0>
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f5b67b1-8b62-508a-bcb7-c0e377fb8051/9f5b67b1-8b62-508a-bcb7-c0e377fb8051_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F12%252F2e12f5a3f023fa9981034a9ff6c5df01%252Fpa%252FLU93439_4e75f4447406f3e743645fb8854ed4ee.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/12/2e12f5a3f023fa9981034a9ff6c5df01/pa/LU93439_4e75f4447406f3e743645fb8854ed4ee.jpg saved to cache
2026-03-28 12:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f5b67b1-8b62-508a-bcb7-c0e377fb8051
2026-03-28 12:06:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc2b8e10>
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fdd%252F71ddf47d2f6b29b49fdb4501aab760e2%252Fpa%252FPK33610_a21e10280aabaaba4484f3a798107a6b.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_a21e10280aabaaba4484f3a798107a6b.jpg saved to cache
2026-03-28 12:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3652c92f-d6ed-5635-a482-c31d8f9fc39d
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc599390>
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87a43274-98c5-525d-99d7-bd65dbd988d3/87a43274-98c5-525d-99d7-bd65dbd988d3_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F3d%252Fad3d95af6de154b8962720c4d301132d%252Fpa%252FVB56015_43a7819e90743a68e723834729b35d12.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_43a7819e90743a68e723834729b35d12.jpg saved to cache
2026-03-28 12:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 87a43274-98c5-525d-99d7-bd65dbd988d3
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc2d1a90>
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f5b67b1-8b62-508a-bcb7-c0e377fb8051/9f5b67b1-8b62-508a-bcb7-c0e377fb8051_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F12%252F2e12f5a3f023fa9981034a9ff6c5df01%252Fpa%252FLU93439_da9546644830d9e5890d6cfe7d745276.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/12/2e12f5a3f023fa9981034a9ff6c5df01/pa/LU93439_da9546644830d9e5890d6cfe7d745276.jpg saved to cache
2026-03-28 12:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f5b67b1-8b62-508a-bcb7-c0e377fb8051
2026-03-28 12:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_2d076204ef391cdd35ae319cf094b2a4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/59/2759fedf1003bfacfe14dabf1bddfa9b/pa/WG00273_a318360e6a78097650201f90889b396d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/59/2759fedf1003bfacfe14dabf1bddfa9b/pa/WG00273_44f6d911a60fc13eaf250de92b5b1a0f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc64dc10>
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87a43274-98c5-525d-99d7-bd65dbd988d3/87a43274-98c5-525d-99d7-bd65dbd988d3_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F3d%252Fad3d95af6de154b8962720c4d301132d%252Fpa%252FVB56015_2a7c273599bf4016ce11e4fe77db6f11.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_2a7c273599bf4016ce11e4fe77db6f11.jpg saved to cache
2026-03-28 12:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 87a43274-98c5-525d-99d7-bd65dbd988d3
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd06d3d0>
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dba344c-9659-55ab-b03c-647479a30b0f/5dba344c-9659-55ab-b03c-647479a30b0f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe0%252F71e02bbca5e8df98969c4264b7c1975a%252Fpa%252FLD34697_56eeece0d0ca71e96f541b404e44174a.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_56eeece0d0ca71e96f541b404e44174a.jpg saved to cache
2026-03-28 12:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5dba344c-9659-55ab-b03c-647479a30b0f
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc629850>
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87a43274-98c5-525d-99d7-bd65dbd988d3/87a43274-98c5-525d-99d7-bd65dbd988d3_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F3d%252Fad3d95af6de154b8962720c4d301132d%252Fpa%252FVB56015_48f1748b344f23965a21ba160c5bb450.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_48f1748b344f23965a21ba160c5bb450.jpg saved to cache
2026-03-28 12:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 87a43274-98c5-525d-99d7-bd65dbd988d3
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcff6550>
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dba344c-9659-55ab-b03c-647479a30b0f/5dba344c-9659-55ab-b03c-647479a30b0f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe0%252F71e02bbca5e8df98969c4264b7c1975a%252Fpa%252FLD34697_da79cf1e646b9bb44f3cc1c3d10198de.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_da79cf1e646b9bb44f3cc1c3d10198de.jpg saved to cache
2026-03-28 12:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5dba344c-9659-55ab-b03c-647479a30b0f
2026-03-28 12:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3eb150>
2026-03-28 12:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6896d477-cffe-57f4-8204-fba01dc762e5/6896d477-cffe-57f4-8204-fba01dc762e5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F59%252F2759fedf1003bfacfe14dabf1bddfa9b%252Fpa%252FWG00273_57ff5e2e827a5dadaa50c376bc69bcac.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/59/2759fedf1003bfacfe14dabf1bddfa9b/pa/WG00273_57ff5e2e827a5dadaa50c376bc69bcac.jpg saved to cache
2026-03-28 12:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6896d477-cffe-57f4-8204-fba01dc762e5
2026-03-28 12:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc64dc10>
2026-03-28 12:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6896d477-cffe-57f4-8204-fba01dc762e5/6896d477-cffe-57f4-8204-fba01dc762e5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F59%252F2759fedf1003bfacfe14dabf1bddfa9b%252Fpa%252FWG00273_d1fb00caed01b721a855ff4705f44116.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/59/2759fedf1003bfacfe14dabf1bddfa9b/pa/WG00273_d1fb00caed01b721a855ff4705f44116.jpg saved to cache
2026-03-28 12:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6896d477-cffe-57f4-8204-fba01dc762e5
2026-03-28 12:06:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21a40b1f-769c-5063-91c5-8404dd3fb1bc with identifier: MX93098
2026-03-28 12:06:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21a40b1f-769c-5063-91c5-8404dd3fb1bc with scrape type 1
2026-03-28 12:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 21a40b1f-769c-5063-91c5-8404dd3fb1bc
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fa4%252F8ca483e23ee04446c207953be30552c3%252Fpa%252FMX93098_4220056242199f76e2928c131221a5ef.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/a4/8ca483e23ee04446c207953be30552c3/pa/MX93098_4220056242199f76e2928c131221a5ef.jpg already downloaded
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fa4%252F8ca483e23ee04446c207953be30552c3%252Fpa%252FMX93098_0be96205796345d568d3e94808c77f4f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/a4/8ca483e23ee04446c207953be30552c3/pa/MX93098_0be96205796345d568d3e94808c77f4f.jpg already downloaded
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fa4%252F8ca483e23ee04446c207953be30552c3%252Fpa%252FMX93098_da1f79b878ea02c53be36ba92e6634dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/a4/8ca483e23ee04446c207953be30552c3/pa/MX93098_da1f79b878ea02c53be36ba92e6634dc.jpg already downloaded
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fa4%252F8ca483e23ee04446c207953be30552c3%252Fpa%252FMX93098_22e0ad78f885c7a293850d45eaef0269.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/a4/8ca483e23ee04446c207953be30552c3/pa/MX93098_22e0ad78f885c7a293850d45eaef0269.jpg already downloaded
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fa4%252F8ca483e23ee04446c207953be30552c3%252Fpa%252FMX93098_0380d3d39cb2f786be7c4208a514759d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/a4/8ca483e23ee04446c207953be30552c3/pa/MX93098_0380d3d39cb2f786be7c4208a514759d.jpg already downloaded
2026-03-28 12:06:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 21a40b1f-769c-5063-91c5-8404dd3fb1bc, identifier: MX93098
2026-03-28 12:06:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 21a40b1f-769c-5063-91c5-8404dd3fb1bc with identifier: MX93098
2026-03-28 12:06:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 21a40b1f-769c-5063-91c5-8404dd3fb1bc with identifier: MX93098
2026-03-28 12:06:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 21a40b1f-769c-5063-91c5-8404dd3fb1bc with identifier: MX93098 to the API
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MX93098>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:48:05Z',
 'fuel_type': 'petrol',
 'id': '21a40b1f-769c-5063-91c5-8404dd3fb1bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX93098',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 255397,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img8c/a4/8ca483e23ee04446c207953be30552c3/pa/MX93098_4220056242199f76e2928c131221a5ef.jpg',
                'https://img-pa.auto1.com/img8c/a4/8ca483e23ee04446c207953be30552c3/pa/MX93098_0be96205796345d568d3e94808c77f4f.jpg',
                'https://img-pa.auto1.com/img8c/a4/8ca483e23ee04446c207953be30552c3/pa/MX93098_da1f79b878ea02c53be36ba92e6634dc.jpg',
                'https://img-pa.auto1.com/img8c/a4/8ca483e23ee04446c207953be30552c3/pa/MX93098_22e0ad78f885c7a293850d45eaef0269.jpg',
                'https://img-pa.auto1.com/img8c/a4/8ca483e23ee04446c207953be30552c3/pa/MX93098_0380d3d39cb2f786be7c4208a514759d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a40b1f-769c-5063-91c5-8404dd3fb1bc/21a40b1f-769c-5063-91c5-8404dd3fb1bc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/a4/8ca483e23ee04446c207953be30552c3/pa/MX93098_4220056242199f76e2928c131221a5ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a40b1f-769c-5063-91c5-8404dd3fb1bc/21a40b1f-769c-5063-91c5-8404dd3fb1bc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/a4/8ca483e23ee04446c207953be30552c3/pa/MX93098_0be96205796345d568d3e94808c77f4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a40b1f-769c-5063-91c5-8404dd3fb1bc/21a40b1f-769c-5063-91c5-8404dd3fb1bc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62574,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/a4/8ca483e23ee04446c207953be30552c3/pa/MX93098_da1f79b878ea02c53be36ba92e6634dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a40b1f-769c-5063-91c5-8404dd3fb1bc/21a40b1f-769c-5063-91c5-8404dd3fb1bc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/a4/8ca483e23ee04446c207953be30552c3/pa/MX93098_22e0ad78f885c7a293850d45eaef0269.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a40b1f-769c-5063-91c5-8404dd3fb1bc/21a40b1f-769c-5063-91c5-8404dd3fb1bc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/a4/8ca483e23ee04446c207953be30552c3/pa/MX93098_0380d3d39cb2f786be7c4208a514759d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2010}
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX93098%27 HTTP/1.1" 200 None
2026-03-28 12:06:57 [auto1.it] INFO: Saving data for MX93098: {'created_time': 1774699617.636463, 'last_price_update_time': 1774699617.636474, 'auction_closing_time': 1774885685.0}
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MX93098') HTTP/1.1" 204 0
2026-03-28 12:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_1b03942475310d056d482267c7a7f1db.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_3cf59c87ebeecc88c4f5122cee3998dd.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd11a210>
2026-03-28 12:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dba344c-9659-55ab-b03c-647479a30b0f/5dba344c-9659-55ab-b03c-647479a30b0f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe0%252F71e02bbca5e8df98969c4264b7c1975a%252Fpa%252FLD34697_2d076204ef391cdd35ae319cf094b2a4.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_2d076204ef391cdd35ae319cf094b2a4.jpg saved to cache
2026-03-28 12:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5dba344c-9659-55ab-b03c-647479a30b0f
2026-03-28 12:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04ccb5d4d0>
2026-03-28 12:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6896d477-cffe-57f4-8204-fba01dc762e5/6896d477-cffe-57f4-8204-fba01dc762e5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F59%252F2759fedf1003bfacfe14dabf1bddfa9b%252Fpa%252FWG00273_a318360e6a78097650201f90889b396d.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/59/2759fedf1003bfacfe14dabf1bddfa9b/pa/WG00273_a318360e6a78097650201f90889b396d.jpg saved to cache
2026-03-28 12:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6896d477-cffe-57f4-8204-fba01dc762e5
2026-03-28 12:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd13d890>
2026-03-28 12:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6896d477-cffe-57f4-8204-fba01dc762e5/6896d477-cffe-57f4-8204-fba01dc762e5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F59%252F2759fedf1003bfacfe14dabf1bddfa9b%252Fpa%252FWG00273_44f6d911a60fc13eaf250de92b5b1a0f.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/59/2759fedf1003bfacfe14dabf1bddfa9b/pa/WG00273_44f6d911a60fc13eaf250de92b5b1a0f.jpg saved to cache
2026-03-28 12:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6896d477-cffe-57f4-8204-fba01dc762e5
2026-03-28 12:06:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6896d477-cffe-57f4-8204-fba01dc762e5, skipping ID generation
2026-03-28 12:06:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6896d477-cffe-57f4-8204-fba01dc762e5 with scrape type 1
2026-03-28 12:06:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6896d477-cffe-57f4-8204-fba01dc762e5 sending to next pipeline
2026-03-28 12:06:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6896d477-cffe-57f4-8204-fba01dc762e5, identifier: WG00273
2026-03-28 12:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/12/2e12f5a3f023fa9981034a9ff6c5df01/pa/LU93439_5a84f3773c40072c79709dc77ad0599e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RK78436> (referer: https://www.auto1.com/v1/car-details-view/RK78436/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6896d477-cffe-57f4-8204-fba01dc762e5 with identifier: WG00273
2026-03-28 12:06:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6896d477-cffe-57f4-8204-fba01dc762e5 with identifier: WG00273
2026-03-28 12:06:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6896d477-cffe-57f4-8204-fba01dc762e5 with identifier: WG00273 to the API
2026-03-28 12:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img27/59/2759fedf1003bfacfe14dabf1bddfa9b/pa/WG00273_44f6d911a60fc13eaf250de92b5b1a0f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': 'Rental',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:34:02Z',
 'fuel_type': 'diesel',
 'id': '6896d477-cffe-57f4-8204-fba01dc762e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG00273',
 'listing': 'auction',
 'location': 'IT, Casoria',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 252607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6896d477-cffe-57f4-8204-fba01dc762e5/6896d477-cffe-57f4-8204-fba01dc762e5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/59/2759fedf1003bfacfe14dabf1bddfa9b/pa/WG00273_a318360e6a78097650201f90889b396d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6896d477-cffe-57f4-8204-fba01dc762e5/6896d477-cffe-57f4-8204-fba01dc762e5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/59/2759fedf1003bfacfe14dabf1bddfa9b/pa/WG00273_44f6d911a60fc13eaf250de92b5b1a0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6896d477-cffe-57f4-8204-fba01dc762e5/6896d477-cffe-57f4-8204-fba01dc762e5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/59/2759fedf1003bfacfe14dabf1bddfa9b/pa/WG00273_fe6569448b0891abaad03e7034169327.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6896d477-cffe-57f4-8204-fba01dc762e5/6896d477-cffe-57f4-8204-fba01dc762e5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/59/2759fedf1003bfacfe14dabf1bddfa9b/pa/WG00273_d1fb00caed01b721a855ff4705f44116.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6896d477-cffe-57f4-8204-fba01dc762e5/6896d477-cffe-57f4-8204-fba01dc762e5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49433,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/59/2759fedf1003bfacfe14dabf1bddfa9b/pa/WG00273_57ff5e2e827a5dadaa50c376bc69bcac.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 TDI Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2009}
2026-03-28 12:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG00273%27 HTTP/1.1" 200 None
2026-03-28 12:06:58 [auto1.it] INFO: Saving data for WG00273: {'created_time': 1774699618.312595, 'last_price_update_time': 1774699618.312606, 'auction_closing_time': 1774884842.0}
2026-03-28 12:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WG00273') HTTP/1.1" 204 0
2026-03-28 12:06:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_e00a2930546a3b20a1d43de860b976e8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_2a9353e4e69516aca8a3d093566b1cfb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VK29965> (referer: https://www.auto1.com/v1/car-details-view/VK29965/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc469fd0>
2026-03-28 12:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dba344c-9659-55ab-b03c-647479a30b0f/5dba344c-9659-55ab-b03c-647479a30b0f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe0%252F71e02bbca5e8df98969c4264b7c1975a%252Fpa%252FLD34697_1b03942475310d056d482267c7a7f1db.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_1b03942475310d056d482267c7a7f1db.jpg saved to cache
2026-03-28 12:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5dba344c-9659-55ab-b03c-647479a30b0f
2026-03-28 12:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bceb75d0>
2026-03-28 12:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87a43274-98c5-525d-99d7-bd65dbd988d3/87a43274-98c5-525d-99d7-bd65dbd988d3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F3d%252Fad3d95af6de154b8962720c4d301132d%252Fpa%252FVB56015_3cf59c87ebeecc88c4f5122cee3998dd.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_3cf59c87ebeecc88c4f5122cee3998dd.jpg saved to cache
2026-03-28 12:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 87a43274-98c5-525d-99d7-bd65dbd988d3
2026-03-28 12:06:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 87a43274-98c5-525d-99d7-bd65dbd988d3, skipping ID generation
2026-03-28 12:06:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87a43274-98c5-525d-99d7-bd65dbd988d3 with scrape type 1
2026-03-28 12:06:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 87a43274-98c5-525d-99d7-bd65dbd988d3 sending to next pipeline
2026-03-28 12:06:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 87a43274-98c5-525d-99d7-bd65dbd988d3, identifier: VB56015
2026-03-28 12:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc600050>
2026-03-28 12:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f5b67b1-8b62-508a-bcb7-c0e377fb8051/9f5b67b1-8b62-508a-bcb7-c0e377fb8051_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F12%252F2e12f5a3f023fa9981034a9ff6c5df01%252Fpa%252FLU93439_5a84f3773c40072c79709dc77ad0599e.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/12/2e12f5a3f023fa9981034a9ff6c5df01/pa/LU93439_5a84f3773c40072c79709dc77ad0599e.jpg saved to cache
2026-03-28 12:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f5b67b1-8b62-508a-bcb7-c0e377fb8051
2026-03-28 12:06:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f5b67b1-8b62-508a-bcb7-c0e377fb8051, skipping ID generation
2026-03-28 12:06:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f5b67b1-8b62-508a-bcb7-c0e377fb8051 with scrape type 1
2026-03-28 12:06:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f5b67b1-8b62-508a-bcb7-c0e377fb8051 sending to next pipeline
2026-03-28 12:06:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9f5b67b1-8b62-508a-bcb7-c0e377fb8051, identifier: LU93439
2026-03-28 12:06:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c16c40ca-e976-5dea-9dd6-99afe4b3c1ae with identifier: RK78436
2026-03-28 12:06:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c16c40ca-e976-5dea-9dd6-99afe4b3c1ae with scrape type 1
2026-03-28 12:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item c16c40ca-e976-5dea-9dd6-99afe4b3c1ae
2026-03-28 12:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fd7%252Fd3d73eb7f7b437d3aae4a438550da980%252Fpa%252FRK78436_91e54a3914ee98eda2ff96395beeb846.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d7/d3d73eb7f7b437d3aae4a438550da980/pa/RK78436_91e54a3914ee98eda2ff96395beeb846.jpg not downloaded yet
2026-03-28 12:06:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 87a43274-98c5-525d-99d7-bd65dbd988d3 with identifier: VB56015
2026-03-28 12:06:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 87a43274-98c5-525d-99d7-bd65dbd988d3 with identifier: VB56015
2026-03-28 12:06:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 87a43274-98c5-525d-99d7-bd65dbd988d3 with identifier: VB56015 to the API
2026-03-28 12:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_3cf59c87ebeecc88c4f5122cee3998dd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:04:41Z',
 'fuel_type': 'diesel',
 'id': '87a43274-98c5-525d-99d7-bd65dbd988d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB56015',
 'listing': 'auction',
 'location': 'IT, Bologna',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 137793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87a43274-98c5-525d-99d7-bd65dbd988d3/87a43274-98c5-525d-99d7-bd65dbd988d3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_bf623c1cabf79cef7af521afe20e86fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87a43274-98c5-525d-99d7-bd65dbd988d3/87a43274-98c5-525d-99d7-bd65dbd988d3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68453,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_6191d1d2f672fc2b432d70eeb278f1ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87a43274-98c5-525d-99d7-bd65dbd988d3/87a43274-98c5-525d-99d7-bd65dbd988d3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_7bc4f44d357247a962f5a1bf89fb2b33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87a43274-98c5-525d-99d7-bd65dbd988d3/87a43274-98c5-525d-99d7-bd65dbd988d3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_0d2c0ed4c1664d815df281bc25bf576c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87a43274-98c5-525d-99d7-bd65dbd988d3/87a43274-98c5-525d-99d7-bd65dbd988d3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_0e86faf231ddf8ba4ac91b0e47136111.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87a43274-98c5-525d-99d7-bd65dbd988d3/87a43274-98c5-525d-99d7-bd65dbd988d3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_3cf59c87ebeecc88c4f5122cee3998dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87a43274-98c5-525d-99d7-bd65dbd988d3/87a43274-98c5-525d-99d7-bd65dbd988d3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_828cda41160f2c130143e1e45ce32994.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87a43274-98c5-525d-99d7-bd65dbd988d3/87a43274-98c5-525d-99d7-bd65dbd988d3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_43a7819e90743a68e723834729b35d12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87a43274-98c5-525d-99d7-bd65dbd988d3/87a43274-98c5-525d-99d7-bd65dbd988d3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_2a7c273599bf4016ce11e4fe77db6f11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87a43274-98c5-525d-99d7-bd65dbd988d3/87a43274-98c5-525d-99d7-bd65dbd988d3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/3d/ad3d95af6de154b8962720c4d301132d/pa/VB56015_48f1748b344f23965a21ba160c5bb450.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford C-Max 1.6 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2011}
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB56015%27 HTTP/1.1" 200 None
2026-03-28 12:06:59 [auto1.it] INFO: Saving data for VB56015: {'created_time': 1774699619.065211, 'last_price_update_time': 1774699619.065222, 'auction_closing_time': 1774883081.0}
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VB56015') HTTP/1.1" 204 0
2026-03-28 12:06:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9f5b67b1-8b62-508a-bcb7-c0e377fb8051 with identifier: LU93439
2026-03-28 12:06:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9f5b67b1-8b62-508a-bcb7-c0e377fb8051 with identifier: LU93439
2026-03-28 12:06:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9f5b67b1-8b62-508a-bcb7-c0e377fb8051 with identifier: LU93439 to the API
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:06:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2e/12/2e12f5a3f023fa9981034a9ff6c5df01/pa/LU93439_5a84f3773c40072c79709dc77ad0599e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:07:14Z',
 'fuel_type': 'diesel',
 'id': '9f5b67b1-8b62-508a-bcb7-c0e377fb8051',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU93439',
 'listing': 'auction',
 'location': 'IT, Livorno',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 99861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f5b67b1-8b62-508a-bcb7-c0e377fb8051/9f5b67b1-8b62-508a-bcb7-c0e377fb8051_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/12/2e12f5a3f023fa9981034a9ff6c5df01/pa/LU93439_4fa6e8e946961aaf81c29ffe57348b6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f5b67b1-8b62-508a-bcb7-c0e377fb8051/9f5b67b1-8b62-508a-bcb7-c0e377fb8051_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58760,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/12/2e12f5a3f023fa9981034a9ff6c5df01/pa/LU93439_06108f3d79fe345efde910f5d5f61696.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f5b67b1-8b62-508a-bcb7-c0e377fb8051/9f5b67b1-8b62-508a-bcb7-c0e377fb8051_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/12/2e12f5a3f023fa9981034a9ff6c5df01/pa/LU93439_5a84f3773c40072c79709dc77ad0599e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f5b67b1-8b62-508a-bcb7-c0e377fb8051/9f5b67b1-8b62-508a-bcb7-c0e377fb8051_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49839,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/12/2e12f5a3f023fa9981034a9ff6c5df01/pa/LU93439_4e75f4447406f3e743645fb8854ed4ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f5b67b1-8b62-508a-bcb7-c0e377fb8051/9f5b67b1-8b62-508a-bcb7-c0e377fb8051_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56381,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/12/2e12f5a3f023fa9981034a9ff6c5df01/pa/LU93439_da9546644830d9e5890d6cfe7d745276.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Punto 1.3 JTD Classic Active',
 'transmission': 'manual',
 'trim': 'Classic Active',
 'year': 2010}
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU93439%27 HTTP/1.1" 200 None
2026-03-28 12:06:59 [auto1.it] INFO: Saving data for LU93439: {'created_time': 1774699619.446168, 'last_price_update_time': 1774699619.446178, 'auction_closing_time': 1774883234.0}
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LU93439') HTTP/1.1" 204 0
2026-03-28 12:06:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fd7%252Fd3d73eb7f7b437d3aae4a438550da980%252Fpa%252FRK78436_fffaa54bddcfa30a5b61ab950c8ec50f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d7/d3d73eb7f7b437d3aae4a438550da980/pa/RK78436_fffaa54bddcfa30a5b61ab950c8ec50f.jpg not downloaded yet
2026-03-28 12:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SD66994> (referer: https://www.auto1.com/v1/car-details-view/SD66994/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_69833282e5d36efb960808b5964e8ebe.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_a29c70ba3cbc59ecbcd3ade34b6fd773.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_f9bf9f7e01c5cc4080c248ee34d30557.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SS75136> (referer: https://www.auto1.com/v1/car-details-view/SS75136/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:06:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc603450>
2026-03-28 12:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dba344c-9659-55ab-b03c-647479a30b0f/5dba344c-9659-55ab-b03c-647479a30b0f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe0%252F71e02bbca5e8df98969c4264b7c1975a%252Fpa%252FLD34697_e00a2930546a3b20a1d43de860b976e8.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_e00a2930546a3b20a1d43de860b976e8.jpg saved to cache
2026-03-28 12:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5dba344c-9659-55ab-b03c-647479a30b0f
2026-03-28 12:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bdd7e4d0>
2026-03-28 12:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dba344c-9659-55ab-b03c-647479a30b0f/5dba344c-9659-55ab-b03c-647479a30b0f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe0%252F71e02bbca5e8df98969c4264b7c1975a%252Fpa%252FLD34697_2a9353e4e69516aca8a3d093566b1cfb.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_2a9353e4e69516aca8a3d093566b1cfb.jpg saved to cache
2026-03-28 12:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5dba344c-9659-55ab-b03c-647479a30b0f
2026-03-28 12:06:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fe6e99e-badc-5a01-b97a-b1995e889268 with identifier: VK29965
2026-03-28 12:06:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fe6e99e-badc-5a01-b97a-b1995e889268 with scrape type 1
2026-03-28 12:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3fe6e99e-badc-5a01-b97a-b1995e889268
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F5d%252Ffe5d347cc4d8d62ce9f1d80b0f488196%252Fpa%252FVK29965_9c80714926174d47343860604ab8f889.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_9c80714926174d47343860604ab8f889.jpg not downloaded yet
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fd7%252Fd3d73eb7f7b437d3aae4a438550da980%252Fpa%252FRK78436_1f800273b7289c8044249605c3801774.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d7/d3d73eb7f7b437d3aae4a438550da980/pa/RK78436_1f800273b7289c8044249605c3801774.jpg not downloaded yet
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F5d%252Ffe5d347cc4d8d62ce9f1d80b0f488196%252Fpa%252FVK29965_897dcc516531e6d393547df5ff8bc0e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_897dcc516531e6d393547df5ff8bc0e1.jpg not downloaded yet
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fd7%252Fd3d73eb7f7b437d3aae4a438550da980%252Fpa%252FRK78436_b7fcba6beab126407c720edbeb542ac0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d7/d3d73eb7f7b437d3aae4a438550da980/pa/RK78436_b7fcba6beab126407c720edbeb542ac0.jpg not downloaded yet
2026-03-28 12:06:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecfc837f-3707-5d5d-a0b0-975b2ea87ef2 with identifier: SD66994
2026-03-28 12:06:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecfc837f-3707-5d5d-a0b0-975b2ea87ef2 with scrape type 1
2026-03-28 12:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ecfc837f-3707-5d5d-a0b0-975b2ea87ef2
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F2b%252F8f2bb6d4411b4575638fb90c0e5c0d3d%252Fpa%252FSD66994_91c644ed13737eb96175ebbd14308cd2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/2b/8f2bb6d4411b4575638fb90c0e5c0d3d/pa/SD66994_91c644ed13737eb96175ebbd14308cd2.jpg already downloaded
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F2b%252F8f2bb6d4411b4575638fb90c0e5c0d3d%252Fpa%252FSD66994_91fd7681cc7688ac7b73a4ca4c592c65.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/2b/8f2bb6d4411b4575638fb90c0e5c0d3d/pa/SD66994_91fd7681cc7688ac7b73a4ca4c592c65.jpg already downloaded
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F2b%252F8f2bb6d4411b4575638fb90c0e5c0d3d%252Fpa%252FSD66994_0485b376ede0c4e6cbbaca9aeeef76c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/2b/8f2bb6d4411b4575638fb90c0e5c0d3d/pa/SD66994_0485b376ede0c4e6cbbaca9aeeef76c0.jpg already downloaded
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F2b%252F8f2bb6d4411b4575638fb90c0e5c0d3d%252Fpa%252FSD66994_8f2d0afcba2580b71649c2a2fab5f4f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/2b/8f2bb6d4411b4575638fb90c0e5c0d3d/pa/SD66994_8f2d0afcba2580b71649c2a2fab5f4f9.jpg already downloaded
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F2b%252F8f2bb6d4411b4575638fb90c0e5c0d3d%252Fpa%252FSD66994_f7ffb415bdf2d1d88193cb05af41f8a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/2b/8f2bb6d4411b4575638fb90c0e5c0d3d/pa/SD66994_f7ffb415bdf2d1d88193cb05af41f8a1.jpg already downloaded
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F2b%252F8f2bb6d4411b4575638fb90c0e5c0d3d%252Fpa%252FSD66994_2a735872d5d0362d29868e8bc82e3b0d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/2b/8f2bb6d4411b4575638fb90c0e5c0d3d/pa/SD66994_2a735872d5d0362d29868e8bc82e3b0d.jpg already downloaded
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F2b%252F8f2bb6d4411b4575638fb90c0e5c0d3d%252Fpa%252FSD66994_558b9eb36c1727860df9d1d1366c54d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/2b/8f2bb6d4411b4575638fb90c0e5c0d3d/pa/SD66994_558b9eb36c1727860df9d1d1366c54d8.jpg already downloaded
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F2b%252F8f2bb6d4411b4575638fb90c0e5c0d3d%252Fpa%252FSD66994_400745204fcd85d4807d6730b78828c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/2b/8f2bb6d4411b4575638fb90c0e5c0d3d/pa/SD66994_400745204fcd85d4807d6730b78828c9.jpg already downloaded
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F2b%252F8f2bb6d4411b4575638fb90c0e5c0d3d%252Fpa%252FSD66994_a057667dfd23f7d400085113e057ca04.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/2b/8f2bb6d4411b4575638fb90c0e5c0d3d/pa/SD66994_a057667dfd23f7d400085113e057ca04.jpg already downloaded
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F2b%252F8f2bb6d4411b4575638fb90c0e5c0d3d%252Fpa%252FSD66994_ec5870a0a03b39c255a5225b06b41ae4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/2b/8f2bb6d4411b4575638fb90c0e5c0d3d/pa/SD66994_ec5870a0a03b39c255a5225b06b41ae4.jpg already downloaded
2026-03-28 12:06:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ecfc837f-3707-5d5d-a0b0-975b2ea87ef2, identifier: SD66994
2026-03-28 12:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd00df90>
2026-03-28 12:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fdd%252F71ddf47d2f6b29b49fdb4501aab760e2%252Fpa%252FPK33610_69833282e5d36efb960808b5964e8ebe.jpg') HTTP/1.1" 204 0
2026-03-28 12:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_69833282e5d36efb960808b5964e8ebe.jpg saved to cache
2026-03-28 12:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3652c92f-d6ed-5635-a482-c31d8f9fc39d
2026-03-28 12:06:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3652c92f-d6ed-5635-a482-c31d8f9fc39d, skipping ID generation
2026-03-28 12:06:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3652c92f-d6ed-5635-a482-c31d8f9fc39d with scrape type 1
2026-03-28 12:06:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3652c92f-d6ed-5635-a482-c31d8f9fc39d sending to next pipeline
2026-03-28 12:07:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3652c92f-d6ed-5635-a482-c31d8f9fc39d, identifier: PK33610
2026-03-28 12:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc64f7d0>
2026-03-28 12:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d9f1cd-13c8-5a12-a075-fc1c6be123f9/03d9f1cd-13c8-5a12-a075-fc1c6be123f9_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F71%252F397150a64bdccd102587a586d843212d%252Fpa%252FLB50046_a29c70ba3cbc59ecbcd3ade34b6fd773.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_a29c70ba3cbc59ecbcd3ade34b6fd773.jpg saved to cache
2026-03-28 12:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 03d9f1cd-13c8-5a12-a075-fc1c6be123f9
2026-03-28 12:07:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 03d9f1cd-13c8-5a12-a075-fc1c6be123f9, skipping ID generation
2026-03-28 12:07:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03d9f1cd-13c8-5a12-a075-fc1c6be123f9 with scrape type 1
2026-03-28 12:07:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 03d9f1cd-13c8-5a12-a075-fc1c6be123f9 sending to next pipeline
2026-03-28 12:07:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 03d9f1cd-13c8-5a12-a075-fc1c6be123f9, identifier: LB50046
2026-03-28 12:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd06f5d0>
2026-03-28 12:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414ee5a8-9966-5155-a7ea-6743de9d969e/414ee5a8-9966-5155-a7ea-6743de9d969e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F4f%252Fb04fe85e59a6f1572dcd7cea19f81faa%252Fpa%252FEG76959_f9bf9f7e01c5cc4080c248ee34d30557.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_f9bf9f7e01c5cc4080c248ee34d30557.jpg saved to cache
2026-03-28 12:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 414ee5a8-9966-5155-a7ea-6743de9d969e
2026-03-28 12:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_dd03df6481c1310e49e4f5bb51871385.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F5d%252Ffe5d347cc4d8d62ce9f1d80b0f488196%252Fpa%252FVK29965_cc32534b9feb210919e6dca30a990a6e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_cc32534b9feb210919e6dca30a990a6e.jpg not downloaded yet
2026-03-28 12:07:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ecfc837f-3707-5d5d-a0b0-975b2ea87ef2 with identifier: SD66994
2026-03-28 12:07:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ecfc837f-3707-5d5d-a0b0-975b2ea87ef2 with identifier: SD66994
2026-03-28 12:07:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ecfc837f-3707-5d5d-a0b0-975b2ea87ef2 with identifier: SD66994 to the API
2026-03-28 12:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SD66994>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:51:57Z',
 'fuel_type': 'petrol',
 'id': 'ecfc837f-3707-5d5d-a0b0-975b2ea87ef2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD66994',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 33069,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img8f/2b/8f2bb6d4411b4575638fb90c0e5c0d3d/pa/SD66994_91c644ed13737eb96175ebbd14308cd2.jpg',
                'https://img-pa.auto1.com/img8f/2b/8f2bb6d4411b4575638fb90c0e5c0d3d/pa/SD66994_91fd7681cc7688ac7b73a4ca4c592c65.jpg',
                'https://img-pa.auto1.com/img8f/2b/8f2bb6d4411b4575638fb90c0e5c0d3d/pa/SD66994_0485b376ede0c4e6cbbaca9aeeef76c0.jpg',
                'https://img-pa.auto1.com/img8f/2b/8f2bb6d4411b4575638fb90c0e5c0d3d/pa/SD66994_8f2d0afcba2580b71649c2a2fab5f4f9.jpg',
                'https://img-pa.auto1.com/img8f/2b/8f2bb6d4411b4575638fb90c0e5c0d3d/pa/SD66994_f7ffb415bdf2d1d88193cb05af41f8a1.jpg',
                'https://img-pa.auto1.com/img8f/2b/8f2bb6d4411b4575638fb90c0e5c0d3d/pa/SD66994_2a735872d5d0362d29868e8bc82e3b0d.jpg',
                'https://img-pa.auto1.com/img8f/2b/8f2bb6d4411b4575638fb90c0e5c0d3d/pa/SD66994_558b9eb36c1727860df9d1d1366c54d8.jpg',
                'https://img-pa.auto1.com/img8f/2b/8f2bb6d4411b4575638fb90c0e5c0d3d/pa/SD66994_400745204fcd85d4807d6730b78828c9.jpg',
                'https://img-pa.auto1.com/img8f/2b/8f2bb6d4411b4575638fb90c0e5c0d3d/pa/SD66994_a057667dfd23f7d400085113e057ca04.jpg',
                'https://img-pa.auto1.com/img8f/2b/8f2bb6d4411b4575638fb90c0e5c0d3d/pa/SD66994_ec5870a0a03b39c255a5225b06b41ae4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecfc837f-3707-5d5d-a0b0-975b2ea87ef2/ecfc837f-3707-5d5d-a0b0-975b2ea87ef2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2650269,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/2b/8f2bb6d4411b4575638fb90c0e5c0d3d/pa/SD66994_91c644ed13737eb96175ebbd14308cd2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecfc837f-3707-5d5d-a0b0-975b2ea87ef2/ecfc837f-3707-5d5d-a0b0-975b2ea87ef2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/2b/8f2bb6d4411b4575638fb90c0e5c0d3d/pa/SD66994_91fd7681cc7688ac7b73a4ca4c592c65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecfc837f-3707-5d5d-a0b0-975b2ea87ef2/ecfc837f-3707-5d5d-a0b0-975b2ea87ef2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82969,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/2b/8f2bb6d4411b4575638fb90c0e5c0d3d/pa/SD66994_0485b376ede0c4e6cbbaca9aeeef76c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecfc837f-3707-5d5d-a0b0-975b2ea87ef2/ecfc837f-3707-5d5d-a0b0-975b2ea87ef2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/2b/8f2bb6d4411b4575638fb90c0e5c0d3d/pa/SD66994_8f2d0afcba2580b71649c2a2fab5f4f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecfc837f-3707-5d5d-a0b0-975b2ea87ef2/ecfc837f-3707-5d5d-a0b0-975b2ea87ef2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/2b/8f2bb6d4411b4575638fb90c0e5c0d3d/pa/SD66994_f7ffb415bdf2d1d88193cb05af41f8a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecfc837f-3707-5d5d-a0b0-975b2ea87ef2/ecfc837f-3707-5d5d-a0b0-975b2ea87ef2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/2b/8f2bb6d4411b4575638fb90c0e5c0d3d/pa/SD66994_2a735872d5d0362d29868e8bc82e3b0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecfc837f-3707-5d5d-a0b0-975b2ea87ef2/ecfc837f-3707-5d5d-a0b0-975b2ea87ef2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2346339,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/2b/8f2bb6d4411b4575638fb90c0e5c0d3d/pa/SD66994_558b9eb36c1727860df9d1d1366c54d8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecfc837f-3707-5d5d-a0b0-975b2ea87ef2/ecfc837f-3707-5d5d-a0b0-975b2ea87ef2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90047,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/2b/8f2bb6d4411b4575638fb90c0e5c0d3d/pa/SD66994_400745204fcd85d4807d6730b78828c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecfc837f-3707-5d5d-a0b0-975b2ea87ef2/ecfc837f-3707-5d5d-a0b0-975b2ea87ef2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2549294,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/2b/8f2bb6d4411b4575638fb90c0e5c0d3d/pa/SD66994_a057667dfd23f7d400085113e057ca04.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecfc837f-3707-5d5d-a0b0-975b2ea87ef2/ecfc837f-3707-5d5d-a0b0-975b2ea87ef2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2547380,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/2b/8f2bb6d4411b4575638fb90c0e5c0d3d/pa/SD66994_ec5870a0a03b39c255a5225b06b41ae4.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2017}
2026-03-28 12:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD66994%27 HTTP/1.1" 200 None
2026-03-28 12:07:00 [auto1.it] INFO: Saving data for SD66994: {'created_time': 1774699620.577812, 'last_price_update_time': 1774699620.577823, 'auction_closing_time': 1774885917.0}
2026-03-28 12:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SD66994') HTTP/1.1" 204 0
2026-03-28 12:07:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3652c92f-d6ed-5635-a482-c31d8f9fc39d with identifier: PK33610
2026-03-28 12:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:07:00 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-28 12:07:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:07:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3652c92f-d6ed-5635-a482-c31d8f9fc39d with identifier: PK33610
2026-03-28 12:07:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3652c92f-d6ed-5635-a482-c31d8f9fc39d with identifier: PK33610 to the API
2026-03-28 12:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_69833282e5d36efb960808b5964e8ebe.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:29:52Z',
 'fuel_type': 'petrol',
 'id': '3652c92f-d6ed-5635-a482-c31d8f9fc39d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK33610',
 'listing': 'auction',
 'location': 'IT, Tradein',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 26446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_69833282e5d36efb960808b5964e8ebe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_3c48f6c3297c30a11e10fd2f09bb8499.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102881,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_0bd7310beaf2ff95d339a4619249b827.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2240284,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_a21e10280aabaaba4484f3a798107a6b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106717,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_5a013466b2cc6e10b9d98dce6f70673e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_233d28178b1ec672dd965ad339c6611d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_c4c1c07fcef296d9242604651dcf5805.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90464,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_3103932431cc3ee03c0374d6d58d1ff0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_7eeedb87ac33c0a890cdb7ef8551dc7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2288054,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_c94c834bd52ca25bfcb9801113b2bae9.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Active Pack',
 'transmission': 'manual',
 'trim': 'Active Pack',
 'year': 2021}
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK33610%27 HTTP/1.1" 200 None
2026-03-28 12:07:01 [auto1.it] INFO: Saving data for PK33610: {'created_time': 1774699621.117402, 'last_price_update_time': 1774699621.117414, 'auction_closing_time': 1774884592.0}
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PK33610') HTTP/1.1" 204 0
2026-03-28 12:07:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 03d9f1cd-13c8-5a12-a075-fc1c6be123f9 with identifier: LB50046
2026-03-28 12:07:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 03d9f1cd-13c8-5a12-a075-fc1c6be123f9 with identifier: LB50046
2026-03-28 12:07:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 03d9f1cd-13c8-5a12-a075-fc1c6be123f9 with identifier: LB50046 to the API
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_a29c70ba3cbc59ecbcd3ade34b6fd773.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': 'Rental',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:03:25Z',
 'fuel_type': 'diesel',
 'id': '03d9f1cd-13c8-5a12-a075-fc1c6be123f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB50046',
 'listing': 'auction',
 'location': 'IT, Verona',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 160217,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03d9f1cd-13c8-5a12-a075-fc1c6be123f9/03d9f1cd-13c8-5a12-a075-fc1c6be123f9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_8b3de6bca8f857187bb4fe2e451f28e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03d9f1cd-13c8-5a12-a075-fc1c6be123f9/03d9f1cd-13c8-5a12-a075-fc1c6be123f9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_b5c9370d08a60b4dc3fd2cf3d84a43e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03d9f1cd-13c8-5a12-a075-fc1c6be123f9/03d9f1cd-13c8-5a12-a075-fc1c6be123f9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64754,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_86cb860455a5c9a865932cccb7d121dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03d9f1cd-13c8-5a12-a075-fc1c6be123f9/03d9f1cd-13c8-5a12-a075-fc1c6be123f9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_5b335238ceeaa33d257bd846c3ff8430.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03d9f1cd-13c8-5a12-a075-fc1c6be123f9/03d9f1cd-13c8-5a12-a075-fc1c6be123f9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_f47dbef26925a37a13d7846374e89b3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03d9f1cd-13c8-5a12-a075-fc1c6be123f9/03d9f1cd-13c8-5a12-a075-fc1c6be123f9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_26e4d51ed88144e09b9a98aca7a141dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03d9f1cd-13c8-5a12-a075-fc1c6be123f9/03d9f1cd-13c8-5a12-a075-fc1c6be123f9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_f5c2eeedf1493ec4ce2dc2ca7cc93266.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03d9f1cd-13c8-5a12-a075-fc1c6be123f9/03d9f1cd-13c8-5a12-a075-fc1c6be123f9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_e1c1e29b8c966247e4cf6787e0179d7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03d9f1cd-13c8-5a12-a075-fc1c6be123f9/03d9f1cd-13c8-5a12-a075-fc1c6be123f9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_a29c70ba3cbc59ecbcd3ade34b6fd773.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03d9f1cd-13c8-5a12-a075-fc1c6be123f9/03d9f1cd-13c8-5a12-a075-fc1c6be123f9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51647,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/71/397150a64bdccd102587a586d843212d/pa/LB50046_95f311b1bace6e962250ebd8f1e26707.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-05-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Yeti 1.6 TDI Ambiton GreenLine',
 'transmission': 'manual',
 'trim': 'Ambiton GreenLine',
 'year': 2013}
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB50046%27 HTTP/1.1" 200 None
2026-03-28 12:07:01 [auto1.it] INFO: Saving data for LB50046: {'created_time': 1774699621.507474, 'last_price_update_time': 1774699621.507485, 'auction_closing_time': 1774883005.0}
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LB50046') HTTP/1.1" 204 0
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fd7%252Fd3d73eb7f7b437d3aae4a438550da980%252Fpa%252FRK78436_abbb1e47ac93f60b4d5f8b938af27b9f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d7/d3d73eb7f7b437d3aae4a438550da980/pa/RK78436_abbb1e47ac93f60b4d5f8b938af27b9f.jpg not downloaded yet
2026-03-28 12:07:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f029de87-54cc-51b1-8c8d-319621cad535 with identifier: SS75136
2026-03-28 12:07:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f029de87-54cc-51b1-8c8d-319621cad535 with scrape type 1
2026-03-28 12:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f029de87-54cc-51b1-8c8d-319621cad535
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fb0%252Fb3b0d4d0286d40b9f3b56936f868c1cd%252Fpa%252FSS75136_20ed99a0b653008cc237f47600d855ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_20ed99a0b653008cc237f47600d855ff.jpg not downloaded yet
2026-03-28 12:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/d7/d3d73eb7f7b437d3aae4a438550da980/pa/RK78436_91e54a3914ee98eda2ff96395beeb846.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_98f58116cf173e14e720d5d22664ca22.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_d6485a9799682b978ec21e41bea7f32f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F5d%252Ffe5d347cc4d8d62ce9f1d80b0f488196%252Fpa%252FVK29965_945c193ca19558f4bc358fc3156713df.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_945c193ca19558f4bc358fc3156713df.jpg not downloaded yet
2026-03-28 12:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EX32240/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZD86423/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CP63934> (referer: https://www.auto1.com/v1/car-details-view/CP63934/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fb0%252Fb3b0d4d0286d40b9f3b56936f868c1cd%252Fpa%252FSS75136_eab79dba74b5e6575191c235d869224b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_eab79dba74b5e6575191c235d869224b.jpg not downloaded yet
2026-03-28 12:07:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3d9250>
2026-03-28 12:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414ee5a8-9966-5155-a7ea-6743de9d969e/414ee5a8-9966-5155-a7ea-6743de9d969e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F4f%252Fb04fe85e59a6f1572dcd7cea19f81faa%252Fpa%252FEG76959_dd03df6481c1310e49e4f5bb51871385.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_dd03df6481c1310e49e4f5bb51871385.jpg saved to cache
2026-03-28 12:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 414ee5a8-9966-5155-a7ea-6743de9d969e
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F5d%252Ffe5d347cc4d8d62ce9f1d80b0f488196%252Fpa%252FVK29965_6a7e050e9cd489e1e892f1ef0744dc8c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_6a7e050e9cd489e1e892f1ef0744dc8c.jpg not downloaded yet
2026-03-28 12:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/d7/d3d73eb7f7b437d3aae4a438550da980/pa/RK78436_b7fcba6beab126407c720edbeb542ac0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fb0%252Fb3b0d4d0286d40b9f3b56936f868c1cd%252Fpa%252FSS75136_d1b3d750a383c0aa53291893d290a8f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_d1b3d750a383c0aa53291893d290a8f2.jpg not downloaded yet
2026-03-28 12:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/d7/d3d73eb7f7b437d3aae4a438550da980/pa/RK78436_fffaa54bddcfa30a5b61ab950c8ec50f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F5d%252Ffe5d347cc4d8d62ce9f1d80b0f488196%252Fpa%252FVK29965_e709423516b615a2a169576c83b0f438.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_e709423516b615a2a169576c83b0f438.jpg not downloaded yet
2026-03-28 12:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc64c710>
2026-03-28 12:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c16c40ca-e976-5dea-9dd6-99afe4b3c1ae/c16c40ca-e976-5dea-9dd6-99afe4b3c1ae_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fd7%252Fd3d73eb7f7b437d3aae4a438550da980%252Fpa%252FRK78436_91e54a3914ee98eda2ff96395beeb846.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d7/d3d73eb7f7b437d3aae4a438550da980/pa/RK78436_91e54a3914ee98eda2ff96395beeb846.jpg saved to cache
2026-03-28 12:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c16c40ca-e976-5dea-9dd6-99afe4b3c1ae
2026-03-28 12:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc39ee10>
2026-03-28 12:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414ee5a8-9966-5155-a7ea-6743de9d969e/414ee5a8-9966-5155-a7ea-6743de9d969e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F4f%252Fb04fe85e59a6f1572dcd7cea19f81faa%252Fpa%252FEG76959_98f58116cf173e14e720d5d22664ca22.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_98f58116cf173e14e720d5d22664ca22.jpg saved to cache
2026-03-28 12:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 414ee5a8-9966-5155-a7ea-6743de9d969e
2026-03-28 12:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfd9190>
2026-03-28 12:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414ee5a8-9966-5155-a7ea-6743de9d969e/414ee5a8-9966-5155-a7ea-6743de9d969e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F4f%252Fb04fe85e59a6f1572dcd7cea19f81faa%252Fpa%252FEG76959_d6485a9799682b978ec21e41bea7f32f.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_d6485a9799682b978ec21e41bea7f32f.jpg saved to cache
2026-03-28 12:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 414ee5a8-9966-5155-a7ea-6743de9d969e
2026-03-28 12:07:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 414ee5a8-9966-5155-a7ea-6743de9d969e, skipping ID generation
2026-03-28 12:07:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 414ee5a8-9966-5155-a7ea-6743de9d969e with scrape type 1
2026-03-28 12:07:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 414ee5a8-9966-5155-a7ea-6743de9d969e sending to next pipeline
2026-03-28 12:07:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 414ee5a8-9966-5155-a7ea-6743de9d969e, identifier: EG76959
2026-03-28 12:07:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5a71111-c106-5fbd-9960-6b2495b2a34a with identifier: CP63934
2026-03-28 12:07:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5a71111-c106-5fbd-9960-6b2495b2a34a with scrape type 1
2026-03-28 12:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a5a71111-c106-5fbd-9960-6b2495b2a34a
2026-03-28 12:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fb1%252F07b126f44cd42aed28c1d16330dfbe17%252Fpa%252FCP63934_460a163a99fd9799598f7ddc860a6f02.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/b1/07b126f44cd42aed28c1d16330dfbe17/pa/CP63934_460a163a99fd9799598f7ddc860a6f02.jpg already downloaded
2026-03-28 12:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fb1%252F07b126f44cd42aed28c1d16330dfbe17%252Fpa%252FCP63934_297383bb44ee7913b9caefca3d0ecfb3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/b1/07b126f44cd42aed28c1d16330dfbe17/pa/CP63934_297383bb44ee7913b9caefca3d0ecfb3.jpg already downloaded
2026-03-28 12:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fb1%252F07b126f44cd42aed28c1d16330dfbe17%252Fpa%252FCP63934_ce1a6f74fb6574e4eed88609771dc13a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/b1/07b126f44cd42aed28c1d16330dfbe17/pa/CP63934_ce1a6f74fb6574e4eed88609771dc13a.jpg already downloaded
2026-03-28 12:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fb1%252F07b126f44cd42aed28c1d16330dfbe17%252Fpa%252FCP63934_960d32ad4cc3beef29cea1779ddd620c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/b1/07b126f44cd42aed28c1d16330dfbe17/pa/CP63934_960d32ad4cc3beef29cea1779ddd620c.jpg already downloaded
2026-03-28 12:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fb1%252F07b126f44cd42aed28c1d16330dfbe17%252Fpa%252FCP63934_3782be243e0747f322c2b1004f5106db.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/b1/07b126f44cd42aed28c1d16330dfbe17/pa/CP63934_3782be243e0747f322c2b1004f5106db.jpg already downloaded
2026-03-28 12:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fb1%252F07b126f44cd42aed28c1d16330dfbe17%252Fpa%252FCP63934_bbb36a2962fb147c56969f128e386532.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/b1/07b126f44cd42aed28c1d16330dfbe17/pa/CP63934_bbb36a2962fb147c56969f128e386532.jpg already downloaded
2026-03-28 12:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fb1%252F07b126f44cd42aed28c1d16330dfbe17%252Fpa%252FCP63934_4b4968440cc4f65ed78c0815064fed67.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/b1/07b126f44cd42aed28c1d16330dfbe17/pa/CP63934_4b4968440cc4f65ed78c0815064fed67.jpg already downloaded
2026-03-28 12:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fb1%252F07b126f44cd42aed28c1d16330dfbe17%252Fpa%252FCP63934_6068f094d0904a65d8ac1ba05e957152.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/b1/07b126f44cd42aed28c1d16330dfbe17/pa/CP63934_6068f094d0904a65d8ac1ba05e957152.jpg already downloaded
2026-03-28 12:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fb1%252F07b126f44cd42aed28c1d16330dfbe17%252Fpa%252FCP63934_6aca830ab77d66f322fcdf2f97a8087d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/b1/07b126f44cd42aed28c1d16330dfbe17/pa/CP63934_6aca830ab77d66f322fcdf2f97a8087d.jpg already downloaded
2026-03-28 12:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fb1%252F07b126f44cd42aed28c1d16330dfbe17%252Fpa%252FCP63934_e555e57bd5074421b4b6c6f81a273924.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/b1/07b126f44cd42aed28c1d16330dfbe17/pa/CP63934_e555e57bd5074421b4b6c6f81a273924.jpg already downloaded
2026-03-28 12:07:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a5a71111-c106-5fbd-9960-6b2495b2a34a, identifier: CP63934
2026-03-28 12:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fb0%252Fb3b0d4d0286d40b9f3b56936f868c1cd%252Fpa%252FSS75136_17db58fae5ddc941f45703fc5c4ab163.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_17db58fae5ddc941f45703fc5c4ab163.jpg not downloaded yet
2026-03-28 12:07:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 414ee5a8-9966-5155-a7ea-6743de9d969e with identifier: EG76959
2026-03-28 12:07:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 414ee5a8-9966-5155-a7ea-6743de9d969e with identifier: EG76959
2026-03-28 12:07:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 414ee5a8-9966-5155-a7ea-6743de9d969e with identifier: EG76959 to the API
2026-03-28 12:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_d6485a9799682b978ec21e41bea7f32f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:32:00Z',
 'fuel_type': 'petrol',
 'id': '414ee5a8-9966-5155-a7ea-6743de9d969e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG76959',
 'listing': 'auction',
 'location': 'IT, Casagiove',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 115364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414ee5a8-9966-5155-a7ea-6743de9d969e/414ee5a8-9966-5155-a7ea-6743de9d969e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_aa2ec67f8dd6c63dc0ee59953539fb7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414ee5a8-9966-5155-a7ea-6743de9d969e/414ee5a8-9966-5155-a7ea-6743de9d969e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101992,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_39a5030bd78d94ce8c319e0b3748d2ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414ee5a8-9966-5155-a7ea-6743de9d969e/414ee5a8-9966-5155-a7ea-6743de9d969e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_0199f5977fce220b8cca06dfdf27ec87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414ee5a8-9966-5155-a7ea-6743de9d969e/414ee5a8-9966-5155-a7ea-6743de9d969e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_d6485a9799682b978ec21e41bea7f32f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414ee5a8-9966-5155-a7ea-6743de9d969e/414ee5a8-9966-5155-a7ea-6743de9d969e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_817fc916388915d1bfa8dd13301013a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414ee5a8-9966-5155-a7ea-6743de9d969e/414ee5a8-9966-5155-a7ea-6743de9d969e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_98f58116cf173e14e720d5d22664ca22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414ee5a8-9966-5155-a7ea-6743de9d969e/414ee5a8-9966-5155-a7ea-6743de9d969e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78646,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_fa2c56790909f2d1c2bbd3c3679dc73b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414ee5a8-9966-5155-a7ea-6743de9d969e/414ee5a8-9966-5155-a7ea-6743de9d969e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_f9bf9f7e01c5cc4080c248ee34d30557.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414ee5a8-9966-5155-a7ea-6743de9d969e/414ee5a8-9966-5155-a7ea-6743de9d969e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_e9bcbf2befff65ec598b3be77179e673.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414ee5a8-9966-5155-a7ea-6743de9d969e/414ee5a8-9966-5155-a7ea-6743de9d969e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3312687,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/4f/b04fe85e59a6f1572dcd7cea19f81faa/pa/EG76959_dd03df6481c1310e49e4f5bb51871385.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-11-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Ford Ka 1.2 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-28 12:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG76959%27 HTTP/1.1" 200 None
2026-03-28 12:07:02 [auto1.it] INFO: Saving data for EG76959: {'created_time': 1774699622.750078, 'last_price_update_time': 1774699622.750088, 'auction_closing_time': 1774884720.0}
2026-03-28 12:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EG76959') HTTP/1.1" 204 0
2026-03-28 12:07:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a5a71111-c106-5fbd-9960-6b2495b2a34a with identifier: CP63934
2026-03-28 12:07:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a5a71111-c106-5fbd-9960-6b2495b2a34a with identifier: CP63934
2026-03-28 12:07:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a5a71111-c106-5fbd-9960-6b2495b2a34a with identifier: CP63934 to the API
2026-03-28 12:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CP63934>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6C',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:23:36Z',
 'fuel_type': 'diesel',
 'id': 'a5a71111-c106-5fbd-9960-6b2495b2a34a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP63934',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 218491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img07/b1/07b126f44cd42aed28c1d16330dfbe17/pa/CP63934_460a163a99fd9799598f7ddc860a6f02.jpg',
                'https://img-pa.auto1.com/img07/b1/07b126f44cd42aed28c1d16330dfbe17/pa/CP63934_297383bb44ee7913b9caefca3d0ecfb3.jpg',
                'https://img-pa.auto1.com/img07/b1/07b126f44cd42aed28c1d16330dfbe17/pa/CP63934_ce1a6f74fb6574e4eed88609771dc13a.jpg',
                'https://img-pa.auto1.com/img07/b1/07b126f44cd42aed28c1d16330dfbe17/pa/CP63934_960d32ad4cc3beef29cea1779ddd620c.jpg',
                'https://img-pa.auto1.com/img07/b1/07b126f44cd42aed28c1d16330dfbe17/pa/CP63934_3782be243e0747f322c2b1004f5106db.jpg',
                'https://img-pa.auto1.com/img07/b1/07b126f44cd42aed28c1d16330dfbe17/pa/CP63934_bbb36a2962fb147c56969f128e386532.jpg',
                'https://img-pa.auto1.com/img07/b1/07b126f44cd42aed28c1d16330dfbe17/pa/CP63934_4b4968440cc4f65ed78c0815064fed67.jpg',
                'https://img-pa.auto1.com/img07/b1/07b126f44cd42aed28c1d16330dfbe17/pa/CP63934_6068f094d0904a65d8ac1ba05e957152.jpg',
                'https://img-pa.auto1.com/img07/b1/07b126f44cd42aed28c1d16330dfbe17/pa/CP63934_6aca830ab77d66f322fcdf2f97a8087d.jpg',
                'https://img-pa.auto1.com/img07/b1/07b126f44cd42aed28c1d16330dfbe17/pa/CP63934_e555e57bd5074421b4b6c6f81a273924.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5a71111-c106-5fbd-9960-6b2495b2a34a/a5a71111-c106-5fbd-9960-6b2495b2a34a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2621843,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/b1/07b126f44cd42aed28c1d16330dfbe17/pa/CP63934_460a163a99fd9799598f7ddc860a6f02.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5a71111-c106-5fbd-9960-6b2495b2a34a/a5a71111-c106-5fbd-9960-6b2495b2a34a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/b1/07b126f44cd42aed28c1d16330dfbe17/pa/CP63934_297383bb44ee7913b9caefca3d0ecfb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5a71111-c106-5fbd-9960-6b2495b2a34a/a5a71111-c106-5fbd-9960-6b2495b2a34a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2603325,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/b1/07b126f44cd42aed28c1d16330dfbe17/pa/CP63934_ce1a6f74fb6574e4eed88609771dc13a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5a71111-c106-5fbd-9960-6b2495b2a34a/a5a71111-c106-5fbd-9960-6b2495b2a34a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2424148,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/b1/07b126f44cd42aed28c1d16330dfbe17/pa/CP63934_960d32ad4cc3beef29cea1779ddd620c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5a71111-c106-5fbd-9960-6b2495b2a34a/a5a71111-c106-5fbd-9960-6b2495b2a34a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/b1/07b126f44cd42aed28c1d16330dfbe17/pa/CP63934_3782be243e0747f322c2b1004f5106db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5a71111-c106-5fbd-9960-6b2495b2a34a/a5a71111-c106-5fbd-9960-6b2495b2a34a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2019165,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/b1/07b126f44cd42aed28c1d16330dfbe17/pa/CP63934_bbb36a2962fb147c56969f128e386532.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5a71111-c106-5fbd-9960-6b2495b2a34a/a5a71111-c106-5fbd-9960-6b2495b2a34a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57535,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/b1/07b126f44cd42aed28c1d16330dfbe17/pa/CP63934_4b4968440cc4f65ed78c0815064fed67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5a71111-c106-5fbd-9960-6b2495b2a34a/a5a71111-c106-5fbd-9960-6b2495b2a34a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/b1/07b126f44cd42aed28c1d16330dfbe17/pa/CP63934_6068f094d0904a65d8ac1ba05e957152.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5a71111-c106-5fbd-9960-6b2495b2a34a/a5a71111-c106-5fbd-9960-6b2495b2a34a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2598229,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/b1/07b126f44cd42aed28c1d16330dfbe17/pa/CP63934_6aca830ab77d66f322fcdf2f97a8087d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5a71111-c106-5fbd-9960-6b2495b2a34a/a5a71111-c106-5fbd-9960-6b2495b2a34a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/b1/07b126f44cd42aed28c1d16330dfbe17/pa/CP63934_e555e57bd5074421b4b6c6f81a273924.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2019}
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP63934%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [auto1.it] INFO: Saving data for CP63934: {'created_time': 1774699623.09519, 'last_price_update_time': 1774699623.0952, 'auction_closing_time': 1774884216.0}
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CP63934') HTTP/1.1" 204 0
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F5d%252Ffe5d347cc4d8d62ce9f1d80b0f488196%252Fpa%252FVK29965_975a16d43c671b257f9ecb88481e8fd7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_975a16d43c671b257f9ecb88481e8fd7.jpg not downloaded yet
2026-03-28 12:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_cc32534b9feb210919e6dca30a990a6e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fb0%252Fb3b0d4d0286d40b9f3b56936f868c1cd%252Fpa%252FSS75136_1948fdafc845c32403f578217a760f91.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_1948fdafc845c32403f578217a760f91.jpg not downloaded yet
2026-03-28 12:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EW38815/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc485390>
2026-03-28 12:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c16c40ca-e976-5dea-9dd6-99afe4b3c1ae/c16c40ca-e976-5dea-9dd6-99afe4b3c1ae_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fd7%252Fd3d73eb7f7b437d3aae4a438550da980%252Fpa%252FRK78436_b7fcba6beab126407c720edbeb542ac0.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d7/d3d73eb7f7b437d3aae4a438550da980/pa/RK78436_b7fcba6beab126407c720edbeb542ac0.jpg saved to cache
2026-03-28 12:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c16c40ca-e976-5dea-9dd6-99afe4b3c1ae
2026-03-28 12:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf4f8d0>
2026-03-28 12:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c16c40ca-e976-5dea-9dd6-99afe4b3c1ae/c16c40ca-e976-5dea-9dd6-99afe4b3c1ae_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fd7%252Fd3d73eb7f7b437d3aae4a438550da980%252Fpa%252FRK78436_fffaa54bddcfa30a5b61ab950c8ec50f.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d7/d3d73eb7f7b437d3aae4a438550da980/pa/RK78436_fffaa54bddcfa30a5b61ab950c8ec50f.jpg saved to cache
2026-03-28 12:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c16c40ca-e976-5dea-9dd6-99afe4b3c1ae
2026-03-28 12:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/d7/d3d73eb7f7b437d3aae4a438550da980/pa/RK78436_1f800273b7289c8044249605c3801774.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_897dcc516531e6d393547df5ff8bc0e1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F5d%252Ffe5d347cc4d8d62ce9f1d80b0f488196%252Fpa%252FVK29965_2269cc5d6ecaccde6fc6363c142a97f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_2269cc5d6ecaccde6fc6363c142a97f3.jpg not downloaded yet
2026-03-28 12:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GC10643> (referer: https://www.auto1.com/v1/car-details-view/GC10643/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fb0%252Fb3b0d4d0286d40b9f3b56936f868c1cd%252Fpa%252FSS75136_6e3b980670d947ecd51ecad0506fa912.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_6e3b980670d947ecd51ecad0506fa912.jpg not downloaded yet
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F5d%252Ffe5d347cc4d8d62ce9f1d80b0f488196%252Fpa%252FVK29965_cf5c67e4c7875dcde71426b2c79beba6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_cf5c67e4c7875dcde71426b2c79beba6.jpg not downloaded yet
2026-03-28 12:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_b3fd0529a5c85ce493aede5f40870682.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fb0%252Fb3b0d4d0286d40b9f3b56936f868c1cd%252Fpa%252FSS75136_308cf5925afabb67e27da5422d5cbac2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_308cf5925afabb67e27da5422d5cbac2.jpg not downloaded yet
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F5d%252Ffe5d347cc4d8d62ce9f1d80b0f488196%252Fpa%252FVK29965_b5bfb56683ce2ba1627757fb2a74ade4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_b5bfb56683ce2ba1627757fb2a74ade4.jpg not downloaded yet
2026-03-28 12:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5fcb90>
2026-03-28 12:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fe6e99e-badc-5a01-b97a-b1995e889268/3fe6e99e-badc-5a01-b97a-b1995e889268_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F5d%252Ffe5d347cc4d8d62ce9f1d80b0f488196%252Fpa%252FVK29965_cc32534b9feb210919e6dca30a990a6e.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_cc32534b9feb210919e6dca30a990a6e.jpg saved to cache
2026-03-28 12:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3fe6e99e-badc-5a01-b97a-b1995e889268
2026-03-28 12:07:03 [auto1.it] INFO: Channel: 24h | Page: 7 | totalHits: 3674 | hits on page: 40
2026-03-28 12:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_9c80714926174d47343860604ab8f889.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fb0%252Fb3b0d4d0286d40b9f3b56936f868c1cd%252Fpa%252FSS75136_fb23d814b347b581fb63f0d74060698e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_fb23d814b347b581fb63f0d74060698e.jpg not downloaded yet
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: HW36660
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW36660%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [auto1.it] INFO: Scrape type for HW36660: 0
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: HR61031
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR61031%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [auto1.it] INFO: Scrape type for HR61031: 0
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: GX37056
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX37056%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [auto1.it] INFO: Scrape type for GX37056: 0
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: RU00933
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: SP24974
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP24974%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [auto1.it] INFO: Scrape type for SP24974: 0
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: WU48756
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU48756%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [auto1.it] INFO: Scrape type for WU48756: 0
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: PR17884
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: XP65023
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: FV28373
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FV28373%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [auto1.it] INFO: Scrape type for FV28373: 0
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: WM91137
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM91137%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [auto1.it] INFO: Scrape type for WM91137: 0
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: BU89130
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BU89130%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [auto1.it] INFO: Scrape type for BU89130: 0
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: MR74044
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR74044%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [auto1.it] INFO: Scrape type for MR74044: 0
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: JB83443
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB83443%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [auto1.it] INFO: Scrape type for JB83443: 0
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: PB47164
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: RU74019
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU74019%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [auto1.it] INFO: Scrape type for RU74019: 0
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: GT62268
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: NY06096
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY06096%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [auto1.it] INFO: Scrape type for NY06096: 0
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: DD11193
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD11193%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [auto1.it] INFO: Scrape type for DD11193: 0
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: TU55073
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU55073%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [auto1.it] INFO: Scrape type for TU55073: 0
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: JC52693
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC52693%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [auto1.it] INFO: Scrape type for JC52693: 0
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: BA37529
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA37529%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [auto1.it] INFO: Scrape type for BA37529: 0
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: PR63683
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR63683%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [auto1.it] INFO: Scrape type for PR63683: 0
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: KC74563
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC74563%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [auto1.it] INFO: Scrape type for KC74563: 0
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: JD73354
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: MB22824
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB22824%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [auto1.it] INFO: Scrape type for MB22824: 0
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: NW35507
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NW35507%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [auto1.it] INFO: Scrape type for NW35507: 0
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: AG64342
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG64342%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [auto1.it] INFO: Scrape type for AG64342: 0
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: RC92896
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC92896%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [auto1.it] INFO: Scrape type for RC92896: 0
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: WK68121
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK68121%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [auto1.it] INFO: Scrape type for WK68121: 0
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: MM70792
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MM70792%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [auto1.it] INFO: Scrape type for MM70792: 0
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: RF74009
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: FD11952
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: VP67579
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP67579%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [auto1.it] INFO: Scrape type for VP67579: 0
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: VM60926
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM60926%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [auto1.it] INFO: Scrape type for VM60926: 0
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: RY72509
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY72509%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [auto1.it] INFO: Scrape type for RY72509: 0
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: UE94474
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UE94474%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [auto1.it] INFO: Scrape type for UE94474: 0
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: LG11591
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: UD99211
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: SX47374
2026-03-28 12:07:03 [auto1.it] INFO: Found listing with ID: AP90035
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP90035%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [auto1.it] INFO: Scrape type for AP90035: 0
2026-03-28 12:07:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fb0%252Fb3b0d4d0286d40b9f3b56936f868c1cd%252Fpa%252FSS75136_ab7c7e554423d05dbc5d3751337fda6f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_ab7c7e554423d05dbc5d3751337fda6f.jpg not downloaded yet
2026-03-28 12:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/d7/d3d73eb7f7b437d3aae4a438550da980/pa/RK78436_abbb1e47ac93f60b4d5f8b938af27b9f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_20ed99a0b653008cc237f47600d855ff.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_2cb744cec3cdaa5e02493ff71a036db1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_cee7b9a1537bc5b6701dc74e3a23bc9c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fb0%252Fb3b0d4d0286d40b9f3b56936f868c1cd%252Fpa%252FSS75136_7e760d2dace710342aa0f65346382c3f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_7e760d2dace710342aa0f65346382c3f.jpg not downloaded yet
2026-03-28 12:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc54d450>
2026-03-28 12:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c16c40ca-e976-5dea-9dd6-99afe4b3c1ae/c16c40ca-e976-5dea-9dd6-99afe4b3c1ae_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fd7%252Fd3d73eb7f7b437d3aae4a438550da980%252Fpa%252FRK78436_1f800273b7289c8044249605c3801774.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d7/d3d73eb7f7b437d3aae4a438550da980/pa/RK78436_1f800273b7289c8044249605c3801774.jpg saved to cache
2026-03-28 12:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c16c40ca-e976-5dea-9dd6-99afe4b3c1ae
2026-03-28 12:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc597090>
2026-03-28 12:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fe6e99e-badc-5a01-b97a-b1995e889268/3fe6e99e-badc-5a01-b97a-b1995e889268_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F5d%252Ffe5d347cc4d8d62ce9f1d80b0f488196%252Fpa%252FVK29965_897dcc516531e6d393547df5ff8bc0e1.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_897dcc516531e6d393547df5ff8bc0e1.jpg saved to cache
2026-03-28 12:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3fe6e99e-badc-5a01-b97a-b1995e889268
2026-03-28 12:07:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8833348-1720-55ca-b6c9-4f7063df27ca with identifier: GC10643
2026-03-28 12:07:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8833348-1720-55ca-b6c9-4f7063df27ca with scrape type 1
2026-03-28 12:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f8833348-1720-55ca-b6c9-4f7063df27ca
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F4a%252Fe44ade93b93c16445c4baad3edcc3798%252Fpa%252FGC10643_7cd50d4f820db1ae1c2612fbb8aba618.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_7cd50d4f820db1ae1c2612fbb8aba618.jpg not downloaded yet
2026-03-28 12:07:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bce83690>
2026-03-28 12:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dba344c-9659-55ab-b03c-647479a30b0f/5dba344c-9659-55ab-b03c-647479a30b0f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe0%252F71e02bbca5e8df98969c4264b7c1975a%252Fpa%252FLD34697_b3fd0529a5c85ce493aede5f40870682.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_b3fd0529a5c85ce493aede5f40870682.jpg saved to cache
2026-03-28 12:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5dba344c-9659-55ab-b03c-647479a30b0f
2026-03-28 12:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd068990>
2026-03-28 12:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fe6e99e-badc-5a01-b97a-b1995e889268/3fe6e99e-badc-5a01-b97a-b1995e889268_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F5d%252Ffe5d347cc4d8d62ce9f1d80b0f488196%252Fpa%252FVK29965_9c80714926174d47343860604ab8f889.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_9c80714926174d47343860604ab8f889.jpg saved to cache
2026-03-28 12:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3fe6e99e-badc-5a01-b97a-b1995e889268
2026-03-28 12:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_e69c8ef70f7ad1b3b9a3c662dd27d15b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F4a%252Fe44ade93b93c16445c4baad3edcc3798%252Fpa%252FGC10643_3f14c0c5ad656064bf5e7d9509945c94.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_3f14c0c5ad656064bf5e7d9509945c94.jpg not downloaded yet
2026-03-28 12:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_eab79dba74b5e6575191c235d869224b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F4a%252Fe44ade93b93c16445c4baad3edcc3798%252Fpa%252FGC10643_f2b3cefa59715d39cd8f2f3e575b6bd0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_f2b3cefa59715d39cd8f2f3e575b6bd0.jpg not downloaded yet
2026-03-28 12:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf36150>
2026-03-28 12:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c16c40ca-e976-5dea-9dd6-99afe4b3c1ae/c16c40ca-e976-5dea-9dd6-99afe4b3c1ae_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fd7%252Fd3d73eb7f7b437d3aae4a438550da980%252Fpa%252FRK78436_abbb1e47ac93f60b4d5f8b938af27b9f.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d7/d3d73eb7f7b437d3aae4a438550da980/pa/RK78436_abbb1e47ac93f60b4d5f8b938af27b9f.jpg saved to cache
2026-03-28 12:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c16c40ca-e976-5dea-9dd6-99afe4b3c1ae
2026-03-28 12:07:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c16c40ca-e976-5dea-9dd6-99afe4b3c1ae, skipping ID generation
2026-03-28 12:07:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c16c40ca-e976-5dea-9dd6-99afe4b3c1ae with scrape type 1
2026-03-28 12:07:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c16c40ca-e976-5dea-9dd6-99afe4b3c1ae sending to next pipeline
2026-03-28 12:07:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c16c40ca-e976-5dea-9dd6-99afe4b3c1ae, identifier: RK78436
2026-03-28 12:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3c2ad0>
2026-03-28 12:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f029de87-54cc-51b1-8c8d-319621cad535/f029de87-54cc-51b1-8c8d-319621cad535_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fb0%252Fb3b0d4d0286d40b9f3b56936f868c1cd%252Fpa%252FSS75136_20ed99a0b653008cc237f47600d855ff.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_20ed99a0b653008cc237f47600d855ff.jpg saved to cache
2026-03-28 12:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f029de87-54cc-51b1-8c8d-319621cad535
2026-03-28 12:07:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bef35950>
2026-03-28 12:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dba344c-9659-55ab-b03c-647479a30b0f/5dba344c-9659-55ab-b03c-647479a30b0f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe0%252F71e02bbca5e8df98969c4264b7c1975a%252Fpa%252FLD34697_2cb744cec3cdaa5e02493ff71a036db1.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_2cb744cec3cdaa5e02493ff71a036db1.jpg saved to cache
2026-03-28 12:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5dba344c-9659-55ab-b03c-647479a30b0f
2026-03-28 12:07:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3978d0>
2026-03-28 12:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dba344c-9659-55ab-b03c-647479a30b0f/5dba344c-9659-55ab-b03c-647479a30b0f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe0%252F71e02bbca5e8df98969c4264b7c1975a%252Fpa%252FLD34697_cee7b9a1537bc5b6701dc74e3a23bc9c.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_cee7b9a1537bc5b6701dc74e3a23bc9c.jpg saved to cache
2026-03-28 12:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5dba344c-9659-55ab-b03c-647479a30b0f
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F4a%252Fe44ade93b93c16445c4baad3edcc3798%252Fpa%252FGC10643_7e892045ca236d898238e3a4ae43401b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_7e892045ca236d898238e3a4ae43401b.jpg not downloaded yet
2026-03-28 12:07:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c16c40ca-e976-5dea-9dd6-99afe4b3c1ae with identifier: RK78436
2026-03-28 12:07:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c16c40ca-e976-5dea-9dd6-99afe4b3c1ae with identifier: RK78436
2026-03-28 12:07:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c16c40ca-e976-5dea-9dd6-99afe4b3c1ae with identifier: RK78436 to the API
2026-03-28 12:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd3/d7/d3d73eb7f7b437d3aae4a438550da980/pa/RK78436_abbb1e47ac93f60b4d5f8b938af27b9f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.1L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:04:35Z',
 'fuel_type': 'petrol',
 'id': 'c16c40ca-e976-5dea-9dd6-99afe4b3c1ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK78436',
 'listing': 'auction',
 'location': 'IT, Piacenza',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 219791,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c16c40ca-e976-5dea-9dd6-99afe4b3c1ae/c16c40ca-e976-5dea-9dd6-99afe4b3c1ae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/d7/d3d73eb7f7b437d3aae4a438550da980/pa/RK78436_91e54a3914ee98eda2ff96395beeb846.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c16c40ca-e976-5dea-9dd6-99afe4b3c1ae/c16c40ca-e976-5dea-9dd6-99afe4b3c1ae_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/d7/d3d73eb7f7b437d3aae4a438550da980/pa/RK78436_fffaa54bddcfa30a5b61ab950c8ec50f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c16c40ca-e976-5dea-9dd6-99afe4b3c1ae/c16c40ca-e976-5dea-9dd6-99afe4b3c1ae_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74621,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/d7/d3d73eb7f7b437d3aae4a438550da980/pa/RK78436_1f800273b7289c8044249605c3801774.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c16c40ca-e976-5dea-9dd6-99afe4b3c1ae/c16c40ca-e976-5dea-9dd6-99afe4b3c1ae_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/d7/d3d73eb7f7b437d3aae4a438550da980/pa/RK78436_b7fcba6beab126407c720edbeb542ac0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c16c40ca-e976-5dea-9dd6-99afe4b3c1ae/c16c40ca-e976-5dea-9dd6-99afe4b3c1ae_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/d7/d3d73eb7f7b437d3aae4a438550da980/pa/RK78436_abbb1e47ac93f60b4d5f8b938af27b9f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.1 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2009}
2026-03-28 12:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK78436%27 HTTP/1.1" 200 None
2026-03-28 12:07:05 [auto1.it] INFO: Saving data for RK78436: {'created_time': 1774699625.345102, 'last_price_update_time': 1774699625.345115, 'auction_closing_time': 1774883075.0}
2026-03-28 12:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RK78436') HTTP/1.1" 204 0
2026-03-28 12:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_17db58fae5ddc941f45703fc5c4ab163.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:05 [scrapy.extensions.logstats] INFO: Crawled 191 pages (at 94 pages/min), scraped 95 items (at 48 items/min)
2026-03-28 12:07:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-28 12:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_975a16d43c671b257f9ecb88481e8fd7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F4a%252Fe44ade93b93c16445c4baad3edcc3798%252Fpa%252FGC10643_671b2646708502b048911dcb777be90c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_671b2646708502b048911dcb777be90c.jpg not downloaded yet
2026-03-28 12:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EX32240> (referer: https://www.auto1.com/v1/car-details-view/EX32240/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZD86423> (referer: https://www.auto1.com/v1/car-details-view/ZD86423/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bf281610>
2026-03-28 12:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dba344c-9659-55ab-b03c-647479a30b0f/5dba344c-9659-55ab-b03c-647479a30b0f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe0%252F71e02bbca5e8df98969c4264b7c1975a%252Fpa%252FLD34697_e69c8ef70f7ad1b3b9a3c662dd27d15b.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_e69c8ef70f7ad1b3b9a3c662dd27d15b.jpg saved to cache
2026-03-28 12:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5dba344c-9659-55ab-b03c-647479a30b0f
2026-03-28 12:07:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5dba344c-9659-55ab-b03c-647479a30b0f, skipping ID generation
2026-03-28 12:07:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dba344c-9659-55ab-b03c-647479a30b0f with scrape type 1
2026-03-28 12:07:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5dba344c-9659-55ab-b03c-647479a30b0f sending to next pipeline
2026-03-28 12:07:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5dba344c-9659-55ab-b03c-647479a30b0f, identifier: LD34697
2026-03-28 12:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3c1ed0>
2026-03-28 12:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f029de87-54cc-51b1-8c8d-319621cad535/f029de87-54cc-51b1-8c8d-319621cad535_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fb0%252Fb3b0d4d0286d40b9f3b56936f868c1cd%252Fpa%252FSS75136_eab79dba74b5e6575191c235d869224b.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_eab79dba74b5e6575191c235d869224b.jpg saved to cache
2026-03-28 12:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f029de87-54cc-51b1-8c8d-319621cad535
2026-03-28 12:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F4a%252Fe44ade93b93c16445c4baad3edcc3798%252Fpa%252FGC10643_4096d3f314c78c38fb04201be86e4abc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_4096d3f314c78c38fb04201be86e4abc.jpg not downloaded yet
2026-03-28 12:07:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5dba344c-9659-55ab-b03c-647479a30b0f with identifier: LD34697
2026-03-28 12:07:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5dba344c-9659-55ab-b03c-647479a30b0f with identifier: LD34697
2026-03-28 12:07:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5dba344c-9659-55ab-b03c-647479a30b0f with identifier: LD34697 to the API
2026-03-28 12:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_e69c8ef70f7ad1b3b9a3c662dd27d15b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:07:02Z',
 'fuel_type': 'diesel',
 'id': '5dba344c-9659-55ab-b03c-647479a30b0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD34697',
 'listing': 'auction',
 'location': 'IT, Parma',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 96975,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dba344c-9659-55ab-b03c-647479a30b0f/5dba344c-9659-55ab-b03c-647479a30b0f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_1b03942475310d056d482267c7a7f1db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dba344c-9659-55ab-b03c-647479a30b0f/5dba344c-9659-55ab-b03c-647479a30b0f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2317443,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_cee7b9a1537bc5b6701dc74e3a23bc9c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dba344c-9659-55ab-b03c-647479a30b0f/5dba344c-9659-55ab-b03c-647479a30b0f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61818,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_56eeece0d0ca71e96f541b404e44174a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dba344c-9659-55ab-b03c-647479a30b0f/5dba344c-9659-55ab-b03c-647479a30b0f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2230841,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_b3fd0529a5c85ce493aede5f40870682.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dba344c-9659-55ab-b03c-647479a30b0f/5dba344c-9659-55ab-b03c-647479a30b0f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_da79cf1e646b9bb44f3cc1c3d10198de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dba344c-9659-55ab-b03c-647479a30b0f/5dba344c-9659-55ab-b03c-647479a30b0f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2337523,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_2cb744cec3cdaa5e02493ff71a036db1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dba344c-9659-55ab-b03c-647479a30b0f/5dba344c-9659-55ab-b03c-647479a30b0f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_2d076204ef391cdd35ae319cf094b2a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dba344c-9659-55ab-b03c-647479a30b0f/5dba344c-9659-55ab-b03c-647479a30b0f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2411531,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_e69c8ef70f7ad1b3b9a3c662dd27d15b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dba344c-9659-55ab-b03c-647479a30b0f/5dba344c-9659-55ab-b03c-647479a30b0f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58665,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_2a9353e4e69516aca8a3d093566b1cfb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dba344c-9659-55ab-b03c-647479a30b0f/5dba344c-9659-55ab-b03c-647479a30b0f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/e0/71e02bbca5e8df98969c4264b7c1975a/pa/LD34697_e00a2930546a3b20a1d43de860b976e8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.5 Blue-HDi Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2019}
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD34697%27 HTTP/1.1" 200 None
2026-03-28 12:07:06 [auto1.it] INFO: Saving data for LD34697: {'created_time': 1774699626.144786, 'last_price_update_time': 1774699626.144801, 'auction_closing_time': 1774883222.0}
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LD34697') HTTP/1.1" 204 0
2026-03-28 12:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_7e892045ca236d898238e3a4ae43401b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_3f14c0c5ad656064bf5e7d9509945c94.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_f2b3cefa59715d39cd8f2f3e575b6bd0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F4a%252Fe44ade93b93c16445c4baad3edcc3798%252Fpa%252FGC10643_bddfc78bbf6392eefe2bbd25bbd46328.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_bddfc78bbf6392eefe2bbd25bbd46328.jpg not downloaded yet
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F4a%252Fe44ade93b93c16445c4baad3edcc3798%252Fpa%252FGC10643_53724fe7b7dac45fdf7958f3cbdf95fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_53724fe7b7dac45fdf7958f3cbdf95fd.jpg not downloaded yet
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc2cfbd0>
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f029de87-54cc-51b1-8c8d-319621cad535/f029de87-54cc-51b1-8c8d-319621cad535_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fb0%252Fb3b0d4d0286d40b9f3b56936f868c1cd%252Fpa%252FSS75136_17db58fae5ddc941f45703fc5c4ab163.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_17db58fae5ddc941f45703fc5c4ab163.jpg saved to cache
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f029de87-54cc-51b1-8c8d-319621cad535
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfcae90>
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fe6e99e-badc-5a01-b97a-b1995e889268/3fe6e99e-badc-5a01-b97a-b1995e889268_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F5d%252Ffe5d347cc4d8d62ce9f1d80b0f488196%252Fpa%252FVK29965_975a16d43c671b257f9ecb88481e8fd7.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_975a16d43c671b257f9ecb88481e8fd7.jpg saved to cache
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3fe6e99e-badc-5a01-b97a-b1995e889268
2026-03-28 12:07:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcb2ce7c-b744-5815-982d-b1f51c9d812b with identifier: EX32240
2026-03-28 12:07:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcb2ce7c-b744-5815-982d-b1f51c9d812b with scrape type 1
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item dcb2ce7c-b744-5815-982d-b1f51c9d812b
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F84%252F32844bd0dd24b1becc05f9339aaec745%252Fpa%252FEX32240_cb07f4ecb84df9cdeeba2a71afe19251.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/84/32844bd0dd24b1becc05f9339aaec745/pa/EX32240_cb07f4ecb84df9cdeeba2a71afe19251.jpg not downloaded yet
2026-03-28 12:07:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee0ce13e-15ea-593a-b11d-05bedfd3bf68 with identifier: ZD86423
2026-03-28 12:07:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee0ce13e-15ea-593a-b11d-05bedfd3bf68 with scrape type 1
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item ee0ce13e-15ea-593a-b11d-05bedfd3bf68
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F9b%252F6d9bfe21368a46de67cc985ae04391b0%252Fpa%252FZD86423_4f5597048d518ceb7bddce52301e7e67.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/9b/6d9bfe21368a46de67cc985ae04391b0/pa/ZD86423_4f5597048d518ceb7bddce52301e7e67.jpg not downloaded yet
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F4a%252Fe44ade93b93c16445c4baad3edcc3798%252Fpa%252FGC10643_f18df8fed9b22b99038f34277b8ad994.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_f18df8fed9b22b99038f34277b8ad994.jpg not downloaded yet
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F84%252F32844bd0dd24b1becc05f9339aaec745%252Fpa%252FEX32240_5a81342aa0cfe88636451819486c99ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/84/32844bd0dd24b1becc05f9339aaec745/pa/EX32240_5a81342aa0cfe88636451819486c99ae.jpg not downloaded yet
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F9b%252F6d9bfe21368a46de67cc985ae04391b0%252Fpa%252FZD86423_cc76c8cd233fa3afecad15c9a79bcd26.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/9b/6d9bfe21368a46de67cc985ae04391b0/pa/ZD86423_cc76c8cd233fa3afecad15c9a79bcd26.jpg not downloaded yet
2026-03-28 12:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_7e760d2dace710342aa0f65346382c3f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_7cd50d4f820db1ae1c2612fbb8aba618.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F4a%252Fe44ade93b93c16445c4baad3edcc3798%252Fpa%252FGC10643_eb79a810eef62b328da0768ab9ffae74.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_eb79a810eef62b328da0768ab9ffae74.jpg not downloaded yet
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F84%252F32844bd0dd24b1becc05f9339aaec745%252Fpa%252FEX32240_4d5bbbd44af92aae3a0fcf39197cbba7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/84/32844bd0dd24b1becc05f9339aaec745/pa/EX32240_4d5bbbd44af92aae3a0fcf39197cbba7.jpg not downloaded yet
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F9b%252F6d9bfe21368a46de67cc985ae04391b0%252Fpa%252FZD86423_00fe062ed2bd03c3808ea9ea4cf7e111.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/9b/6d9bfe21368a46de67cc985ae04391b0/pa/ZD86423_00fe062ed2bd03c3808ea9ea4cf7e111.jpg not downloaded yet
2026-03-28 12:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_ab7c7e554423d05dbc5d3751337fda6f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3b3110>
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8833348-1720-55ca-b6c9-4f7063df27ca/f8833348-1720-55ca-b6c9-4f7063df27ca_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F4a%252Fe44ade93b93c16445c4baad3edcc3798%252Fpa%252FGC10643_7e892045ca236d898238e3a4ae43401b.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_7e892045ca236d898238e3a4ae43401b.jpg saved to cache
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f8833348-1720-55ca-b6c9-4f7063df27ca
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3a4810>
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8833348-1720-55ca-b6c9-4f7063df27ca/f8833348-1720-55ca-b6c9-4f7063df27ca_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F4a%252Fe44ade93b93c16445c4baad3edcc3798%252Fpa%252FGC10643_3f14c0c5ad656064bf5e7d9509945c94.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_3f14c0c5ad656064bf5e7d9509945c94.jpg saved to cache
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f8833348-1720-55ca-b6c9-4f7063df27ca
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04beec8410>
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8833348-1720-55ca-b6c9-4f7063df27ca/f8833348-1720-55ca-b6c9-4f7063df27ca_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F4a%252Fe44ade93b93c16445c4baad3edcc3798%252Fpa%252FGC10643_f2b3cefa59715d39cd8f2f3e575b6bd0.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_f2b3cefa59715d39cd8f2f3e575b6bd0.jpg saved to cache
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f8833348-1720-55ca-b6c9-4f7063df27ca
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F84%252F32844bd0dd24b1becc05f9339aaec745%252Fpa%252FEX32240_46971d3126890995022190dc6558ff4c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/84/32844bd0dd24b1becc05f9339aaec745/pa/EX32240_46971d3126890995022190dc6558ff4c.jpg not downloaded yet
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F9b%252F6d9bfe21368a46de67cc985ae04391b0%252Fpa%252FZD86423_4e24709eb099def06a65ddbe8e066a03.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/9b/6d9bfe21368a46de67cc985ae04391b0/pa/ZD86423_4e24709eb099def06a65ddbe8e066a03.jpg not downloaded yet
2026-03-28 12:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_00c451b6d3564b601b6ace810cd3d0e4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F84%252F32844bd0dd24b1becc05f9339aaec745%252Fpa%252FEX32240_30b5625a135b8e456e34db4d008adc6a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/84/32844bd0dd24b1becc05f9339aaec745/pa/EX32240_30b5625a135b8e456e34db4d008adc6a.jpg not downloaded yet
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F9b%252F6d9bfe21368a46de67cc985ae04391b0%252Fpa%252FZD86423_eb39ab04688d61639a58b8f25db63851.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/9b/6d9bfe21368a46de67cc985ae04391b0/pa/ZD86423_eb39ab04688d61639a58b8f25db63851.jpg not downloaded yet
2026-03-28 12:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EW38815> (referer: https://www.auto1.com/v1/car-details-view/EW38815/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd04bb10>
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f029de87-54cc-51b1-8c8d-319621cad535/f029de87-54cc-51b1-8c8d-319621cad535_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fb0%252Fb3b0d4d0286d40b9f3b56936f868c1cd%252Fpa%252FSS75136_7e760d2dace710342aa0f65346382c3f.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_7e760d2dace710342aa0f65346382c3f.jpg saved to cache
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f029de87-54cc-51b1-8c8d-319621cad535
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc670350>
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8833348-1720-55ca-b6c9-4f7063df27ca/f8833348-1720-55ca-b6c9-4f7063df27ca_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F4a%252Fe44ade93b93c16445c4baad3edcc3798%252Fpa%252FGC10643_7cd50d4f820db1ae1c2612fbb8aba618.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_7cd50d4f820db1ae1c2612fbb8aba618.jpg saved to cache
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8833348-1720-55ca-b6c9-4f7063df27ca
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd06dd50>
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f029de87-54cc-51b1-8c8d-319621cad535/f029de87-54cc-51b1-8c8d-319621cad535_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fb0%252Fb3b0d4d0286d40b9f3b56936f868c1cd%252Fpa%252FSS75136_ab7c7e554423d05dbc5d3751337fda6f.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_ab7c7e554423d05dbc5d3751337fda6f.jpg saved to cache
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f029de87-54cc-51b1-8c8d-319621cad535
2026-03-28 12:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_4096d3f314c78c38fb04201be86e4abc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_fb23d814b347b581fb63f0d74060698e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_308cf5925afabb67e27da5422d5cbac2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc2d1fd0>
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_226ea16f-8e4c-5c8c-8029-e732542d307f/226ea16f-8e4c-5c8c-8029-e732542d307f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F38%252F40380e14f263dd4a58844d0c434613aa%252Fpa%252FPR73005_00c451b6d3564b601b6ace810cd3d0e4.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_00c451b6d3564b601b6ace810cd3d0e4.jpg saved to cache
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 226ea16f-8e4c-5c8c-8029-e732542d307f
2026-03-28 12:07:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d472da71-a6c3-5c89-bdce-60574e916ef6 with identifier: EW38815
2026-03-28 12:07:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d472da71-a6c3-5c89-bdce-60574e916ef6 with scrape type 1
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d472da71-a6c3-5c89-bdce-60574e916ef6
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F41%252Fa3417e2d2250c2a9e15051ebef8fc35d%252Fpa%252FEW38815_e76b05a98986912f836abf8455de1e7a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_e76b05a98986912f836abf8455de1e7a.jpg not downloaded yet
2026-03-28 12:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_b5bfb56683ce2ba1627757fb2a74ade4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_671b2646708502b048911dcb777be90c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F41%252Fa3417e2d2250c2a9e15051ebef8fc35d%252Fpa%252FEW38815_f2caa211d75568ccac8428c35d9c72a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_f2caa211d75568ccac8428c35d9c72a6.jpg not downloaded yet
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F41%252Fa3417e2d2250c2a9e15051ebef8fc35d%252Fpa%252FEW38815_c1dc91bceb88148c29b46388e5804494.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_c1dc91bceb88148c29b46388e5804494.jpg not downloaded yet
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc583d90>
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8833348-1720-55ca-b6c9-4f7063df27ca/f8833348-1720-55ca-b6c9-4f7063df27ca_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F4a%252Fe44ade93b93c16445c4baad3edcc3798%252Fpa%252FGC10643_4096d3f314c78c38fb04201be86e4abc.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_4096d3f314c78c38fb04201be86e4abc.jpg saved to cache
2026-03-28 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f8833348-1720-55ca-b6c9-4f7063df27ca
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bf1bd610>
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f029de87-54cc-51b1-8c8d-319621cad535/f029de87-54cc-51b1-8c8d-319621cad535_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fb0%252Fb3b0d4d0286d40b9f3b56936f868c1cd%252Fpa%252FSS75136_fb23d814b347b581fb63f0d74060698e.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_fb23d814b347b581fb63f0d74060698e.jpg saved to cache
2026-03-28 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f029de87-54cc-51b1-8c8d-319621cad535
2026-03-28 12:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd102750>
2026-03-28 12:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f029de87-54cc-51b1-8c8d-319621cad535/f029de87-54cc-51b1-8c8d-319621cad535_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fb0%252Fb3b0d4d0286d40b9f3b56936f868c1cd%252Fpa%252FSS75136_308cf5925afabb67e27da5422d5cbac2.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_308cf5925afabb67e27da5422d5cbac2.jpg saved to cache
2026-03-28 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f029de87-54cc-51b1-8c8d-319621cad535
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F41%252Fa3417e2d2250c2a9e15051ebef8fc35d%252Fpa%252FEW38815_d2482cd0d04fbb0d70dd7d648c452442.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_d2482cd0d04fbb0d70dd7d648c452442.jpg not downloaded yet
2026-03-28 12:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_f18df8fed9b22b99038f34277b8ad994.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/9b/6d9bfe21368a46de67cc985ae04391b0/pa/ZD86423_cc76c8cd233fa3afecad15c9a79bcd26.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_6e3b980670d947ecd51ecad0506fa912.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F41%252Fa3417e2d2250c2a9e15051ebef8fc35d%252Fpa%252FEW38815_3c5d94145c8ce840dcc8fb0ae82e5b81.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_3c5d94145c8ce840dcc8fb0ae82e5b81.jpg not downloaded yet
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F41%252Fa3417e2d2250c2a9e15051ebef8fc35d%252Fpa%252FEW38815_a310fbeeb776d7b32f4777e9f5a93c49.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_a310fbeeb776d7b32f4777e9f5a93c49.jpg not downloaded yet
2026-03-28 12:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd101550>
2026-03-28 12:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fe6e99e-badc-5a01-b97a-b1995e889268/3fe6e99e-badc-5a01-b97a-b1995e889268_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F5d%252Ffe5d347cc4d8d62ce9f1d80b0f488196%252Fpa%252FVK29965_b5bfb56683ce2ba1627757fb2a74ade4.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_b5bfb56683ce2ba1627757fb2a74ade4.jpg saved to cache
2026-03-28 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3fe6e99e-badc-5a01-b97a-b1995e889268
2026-03-28 12:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfbd410>
2026-03-28 12:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8833348-1720-55ca-b6c9-4f7063df27ca/f8833348-1720-55ca-b6c9-4f7063df27ca_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F4a%252Fe44ade93b93c16445c4baad3edcc3798%252Fpa%252FGC10643_671b2646708502b048911dcb777be90c.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_671b2646708502b048911dcb777be90c.jpg saved to cache
2026-03-28 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f8833348-1720-55ca-b6c9-4f7063df27ca
2026-03-28 12:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/84/32844bd0dd24b1becc05f9339aaec745/pa/EX32240_5a81342aa0cfe88636451819486c99ae.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F41%252Fa3417e2d2250c2a9e15051ebef8fc35d%252Fpa%252FEW38815_17d9a0c9365838ff8ba64023379afe42.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_17d9a0c9365838ff8ba64023379afe42.jpg not downloaded yet
2026-03-28 12:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/9b/6d9bfe21368a46de67cc985ae04391b0/pa/ZD86423_4e24709eb099def06a65ddbe8e066a03.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F41%252Fa3417e2d2250c2a9e15051ebef8fc35d%252Fpa%252FEW38815_7be50a3e25d4015749ed4f853249b134.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_7be50a3e25d4015749ed4f853249b134.jpg not downloaded yet
2026-03-28 12:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf7a210>
2026-03-28 12:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8833348-1720-55ca-b6c9-4f7063df27ca/f8833348-1720-55ca-b6c9-4f7063df27ca_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F4a%252Fe44ade93b93c16445c4baad3edcc3798%252Fpa%252FGC10643_f18df8fed9b22b99038f34277b8ad994.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_f18df8fed9b22b99038f34277b8ad994.jpg saved to cache
2026-03-28 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f8833348-1720-55ca-b6c9-4f7063df27ca
2026-03-28 12:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfae250>
2026-03-28 12:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0ce13e-15ea-593a-b11d-05bedfd3bf68/ee0ce13e-15ea-593a-b11d-05bedfd3bf68_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F9b%252F6d9bfe21368a46de67cc985ae04391b0%252Fpa%252FZD86423_cc76c8cd233fa3afecad15c9a79bcd26.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/9b/6d9bfe21368a46de67cc985ae04391b0/pa/ZD86423_cc76c8cd233fa3afecad15c9a79bcd26.jpg saved to cache
2026-03-28 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ee0ce13e-15ea-593a-b11d-05bedfd3bf68
2026-03-28 12:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bce9b550>
2026-03-28 12:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f029de87-54cc-51b1-8c8d-319621cad535/f029de87-54cc-51b1-8c8d-319621cad535_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fb0%252Fb3b0d4d0286d40b9f3b56936f868c1cd%252Fpa%252FSS75136_6e3b980670d947ecd51ecad0506fa912.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_6e3b980670d947ecd51ecad0506fa912.jpg saved to cache
2026-03-28 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f029de87-54cc-51b1-8c8d-319621cad535
2026-03-28 12:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/84/32844bd0dd24b1becc05f9339aaec745/pa/EX32240_46971d3126890995022190dc6558ff4c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F41%252Fa3417e2d2250c2a9e15051ebef8fc35d%252Fpa%252FEW38815_fd2c7924ce868822ead29c7f6059be1f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_fd2c7924ce868822ead29c7f6059be1f.jpg not downloaded yet
2026-03-28 12:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/9b/6d9bfe21368a46de67cc985ae04391b0/pa/ZD86423_eb39ab04688d61639a58b8f25db63851.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/9b/6d9bfe21368a46de67cc985ae04391b0/pa/ZD86423_00fe062ed2bd03c3808ea9ea4cf7e111.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F41%252Fa3417e2d2250c2a9e15051ebef8fc35d%252Fpa%252FEW38815_469ea1bf1808bdf309922331e09c8742.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_469ea1bf1808bdf309922331e09c8742.jpg not downloaded yet
2026-03-28 12:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/84/32844bd0dd24b1becc05f9339aaec745/pa/EX32240_30b5625a135b8e456e34db4d008adc6a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd11a990>
2026-03-28 12:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcb2ce7c-b744-5815-982d-b1f51c9d812b/dcb2ce7c-b744-5815-982d-b1f51c9d812b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F84%252F32844bd0dd24b1becc05f9339aaec745%252Fpa%252FEX32240_5a81342aa0cfe88636451819486c99ae.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/84/32844bd0dd24b1becc05f9339aaec745/pa/EX32240_5a81342aa0cfe88636451819486c99ae.jpg saved to cache
2026-03-28 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dcb2ce7c-b744-5815-982d-b1f51c9d812b
2026-03-28 12:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc54db90>
2026-03-28 12:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0ce13e-15ea-593a-b11d-05bedfd3bf68/ee0ce13e-15ea-593a-b11d-05bedfd3bf68_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F9b%252F6d9bfe21368a46de67cc985ae04391b0%252Fpa%252FZD86423_4e24709eb099def06a65ddbe8e066a03.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/9b/6d9bfe21368a46de67cc985ae04391b0/pa/ZD86423_4e24709eb099def06a65ddbe8e066a03.jpg saved to cache
2026-03-28 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ee0ce13e-15ea-593a-b11d-05bedfd3bf68
2026-03-28 12:07:07 [auto1.it] INFO: Channel: 24h | Page: 8 | totalHits: 3674 | hits on page: 40
2026-03-28 12:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_c1dc91bceb88148c29b46388e5804494.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: NS10029
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: BY89134
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY89134%27 HTTP/1.1" 200 None
2026-03-28 12:07:07 [auto1.it] INFO: Scrape type for BY89134: 0
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: TW88152
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: MU21056
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU21056%27 HTTP/1.1" 200 None
2026-03-28 12:07:07 [auto1.it] INFO: Scrape type for MU21056: 0
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: BG29864
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: XE56181
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE56181%27 HTTP/1.1" 200 None
2026-03-28 12:07:07 [auto1.it] INFO: Scrape type for XE56181: 0
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: WY26414
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: CP34925
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP34925%27 HTTP/1.1" 200 None
2026-03-28 12:07:07 [auto1.it] INFO: Scrape type for CP34925: 0
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: UB84582
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB84582%27 HTTP/1.1" 200 None
2026-03-28 12:07:07 [auto1.it] INFO: Scrape type for UB84582: 0
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: HY41860
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: CB28979
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB28979%27 HTTP/1.1" 200 None
2026-03-28 12:07:07 [auto1.it] INFO: Scrape type for CB28979: 0
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: FD69176
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: RG05236
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG05236%27 HTTP/1.1" 200 None
2026-03-28 12:07:07 [auto1.it] INFO: Scrape type for RG05236: 0
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: MN63848
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN63848%27 HTTP/1.1" 200 None
2026-03-28 12:07:07 [auto1.it] INFO: Scrape type for MN63848: 0
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: GC15950
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC15950%27 HTTP/1.1" 200 None
2026-03-28 12:07:07 [auto1.it] INFO: Scrape type for GC15950: 0
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: ZU87038
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: YR71782
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR71782%27 HTTP/1.1" 200 None
2026-03-28 12:07:07 [auto1.it] INFO: Scrape type for YR71782: 0
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: RX70685
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX70685%27 HTTP/1.1" 200 None
2026-03-28 12:07:07 [auto1.it] INFO: Scrape type for RX70685: 0
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: ZG33148
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: JP42061
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP42061%27 HTTP/1.1" 200 None
2026-03-28 12:07:07 [auto1.it] INFO: Scrape type for JP42061: 0
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: PR59695
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR59695%27 HTTP/1.1" 200 None
2026-03-28 12:07:07 [auto1.it] INFO: Scrape type for PR59695: 0
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: YC40082
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YC40082%27 HTTP/1.1" 200 None
2026-03-28 12:07:07 [auto1.it] INFO: Scrape type for YC40082: 0
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: AL09653
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL09653%27 HTTP/1.1" 200 None
2026-03-28 12:07:07 [auto1.it] INFO: Scrape type for AL09653: 0
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: DK55043
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK55043%27 HTTP/1.1" 200 None
2026-03-28 12:07:07 [auto1.it] INFO: Scrape type for DK55043: 0
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: AG82147
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: RG79014
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: NU26591
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NU26591%27 HTTP/1.1" 200 None
2026-03-28 12:07:07 [auto1.it] INFO: Scrape type for NU26591: 0
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: UB42424
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB42424%27 HTTP/1.1" 200 None
2026-03-28 12:07:07 [auto1.it] INFO: Scrape type for UB42424: 0
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: RV63380
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV63380%27 HTTP/1.1" 200 None
2026-03-28 12:07:07 [auto1.it] INFO: Scrape type for RV63380: 0
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: JE70672
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE70672%27 HTTP/1.1" 200 None
2026-03-28 12:07:07 [auto1.it] INFO: Scrape type for JE70672: 0
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: KL44785
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL44785%27 HTTP/1.1" 200 None
2026-03-28 12:07:07 [auto1.it] INFO: Scrape type for KL44785: 0
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: TU59167
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU59167%27 HTTP/1.1" 200 None
2026-03-28 12:07:07 [auto1.it] INFO: Scrape type for TU59167: 0
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: TD04886
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD04886%27 HTTP/1.1" 200 None
2026-03-28 12:07:07 [auto1.it] INFO: Scrape type for TD04886: 0
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: NK26905
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK26905%27 HTTP/1.1" 200 None
2026-03-28 12:07:07 [auto1.it] INFO: Scrape type for NK26905: 0
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: PL47981
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: EP64063
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP64063%27 HTTP/1.1" 200 None
2026-03-28 12:07:07 [auto1.it] INFO: Scrape type for EP64063: 0
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: XS31843
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: DP98022
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP98022%27 HTTP/1.1" 200 None
2026-03-28 12:07:07 [auto1.it] INFO: Scrape type for DP98022: 0
2026-03-28 12:07:07 [auto1.it] INFO: Found listing with ID: TZ57511
2026-03-28 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ57511%27 HTTP/1.1" 200 None
2026-03-28 12:07:08 [auto1.it] INFO: Scrape type for TZ57511: 0
2026-03-28 12:07:08 [auto1.it] INFO: Found listing with ID: XF75286
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF75286%27 HTTP/1.1" 200 None
2026-03-28 12:07:08 [auto1.it] INFO: Scrape type for XF75286: 0
2026-03-28 12:07:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_6a7e050e9cd489e1e892f1ef0744dc8c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_d2482cd0d04fbb0d70dd7d648c452442.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfcdb50>
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcb2ce7c-b744-5815-982d-b1f51c9d812b/dcb2ce7c-b744-5815-982d-b1f51c9d812b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F84%252F32844bd0dd24b1becc05f9339aaec745%252Fpa%252FEX32240_46971d3126890995022190dc6558ff4c.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/84/32844bd0dd24b1becc05f9339aaec745/pa/EX32240_46971d3126890995022190dc6558ff4c.jpg saved to cache
2026-03-28 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dcb2ce7c-b744-5815-982d-b1f51c9d812b
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5ab8d0>
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0ce13e-15ea-593a-b11d-05bedfd3bf68/ee0ce13e-15ea-593a-b11d-05bedfd3bf68_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F9b%252F6d9bfe21368a46de67cc985ae04391b0%252Fpa%252FZD86423_eb39ab04688d61639a58b8f25db63851.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/9b/6d9bfe21368a46de67cc985ae04391b0/pa/ZD86423_eb39ab04688d61639a58b8f25db63851.jpg saved to cache
2026-03-28 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ee0ce13e-15ea-593a-b11d-05bedfd3bf68
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd0c6550>
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0ce13e-15ea-593a-b11d-05bedfd3bf68/ee0ce13e-15ea-593a-b11d-05bedfd3bf68_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F9b%252F6d9bfe21368a46de67cc985ae04391b0%252Fpa%252FZD86423_00fe062ed2bd03c3808ea9ea4cf7e111.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/9b/6d9bfe21368a46de67cc985ae04391b0/pa/ZD86423_00fe062ed2bd03c3808ea9ea4cf7e111.jpg saved to cache
2026-03-28 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ee0ce13e-15ea-593a-b11d-05bedfd3bf68
2026-03-28 12:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_1948fdafc845c32403f578217a760f91.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/84/32844bd0dd24b1becc05f9339aaec745/pa/EX32240_4d5bbbd44af92aae3a0fcf39197cbba7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04beed88d0>
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcb2ce7c-b744-5815-982d-b1f51c9d812b/dcb2ce7c-b744-5815-982d-b1f51c9d812b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F84%252F32844bd0dd24b1becc05f9339aaec745%252Fpa%252FEX32240_30b5625a135b8e456e34db4d008adc6a.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/84/32844bd0dd24b1becc05f9339aaec745/pa/EX32240_30b5625a135b8e456e34db4d008adc6a.jpg saved to cache
2026-03-28 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dcb2ce7c-b744-5815-982d-b1f51c9d812b
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfc9d90>
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d472da71-a6c3-5c89-bdce-60574e916ef6/d472da71-a6c3-5c89-bdce-60574e916ef6_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F41%252Fa3417e2d2250c2a9e15051ebef8fc35d%252Fpa%252FEW38815_c1dc91bceb88148c29b46388e5804494.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_c1dc91bceb88148c29b46388e5804494.jpg saved to cache
2026-03-28 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d472da71-a6c3-5c89-bdce-60574e916ef6
2026-03-28 12:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_f2caa211d75568ccac8428c35d9c72a6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_a310fbeeb776d7b32f4777e9f5a93c49.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_cf5c67e4c7875dcde71426b2c79beba6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3bff50>
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fe6e99e-badc-5a01-b97a-b1995e889268/3fe6e99e-badc-5a01-b97a-b1995e889268_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F5d%252Ffe5d347cc4d8d62ce9f1d80b0f488196%252Fpa%252FVK29965_6a7e050e9cd489e1e892f1ef0744dc8c.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_6a7e050e9cd489e1e892f1ef0744dc8c.jpg saved to cache
2026-03-28 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3fe6e99e-badc-5a01-b97a-b1995e889268
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bf1bc390>
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d472da71-a6c3-5c89-bdce-60574e916ef6/d472da71-a6c3-5c89-bdce-60574e916ef6_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F41%252Fa3417e2d2250c2a9e15051ebef8fc35d%252Fpa%252FEW38815_d2482cd0d04fbb0d70dd7d648c452442.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_d2482cd0d04fbb0d70dd7d648c452442.jpg saved to cache
2026-03-28 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d472da71-a6c3-5c89-bdce-60574e916ef6
2026-03-28 12:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_eb79a810eef62b328da0768ab9ffae74.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_e709423516b615a2a169576c83b0f438.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc469450>
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f029de87-54cc-51b1-8c8d-319621cad535/f029de87-54cc-51b1-8c8d-319621cad535_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fb0%252Fb3b0d4d0286d40b9f3b56936f868c1cd%252Fpa%252FSS75136_1948fdafc845c32403f578217a760f91.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_1948fdafc845c32403f578217a760f91.jpg saved to cache
2026-03-28 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f029de87-54cc-51b1-8c8d-319621cad535
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd149e90>
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcb2ce7c-b744-5815-982d-b1f51c9d812b/dcb2ce7c-b744-5815-982d-b1f51c9d812b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F84%252F32844bd0dd24b1becc05f9339aaec745%252Fpa%252FEX32240_4d5bbbd44af92aae3a0fcf39197cbba7.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/84/32844bd0dd24b1becc05f9339aaec745/pa/EX32240_4d5bbbd44af92aae3a0fcf39197cbba7.jpg saved to cache
2026-03-28 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dcb2ce7c-b744-5815-982d-b1f51c9d812b
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc55a990>
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d472da71-a6c3-5c89-bdce-60574e916ef6/d472da71-a6c3-5c89-bdce-60574e916ef6_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F41%252Fa3417e2d2250c2a9e15051ebef8fc35d%252Fpa%252FEW38815_f2caa211d75568ccac8428c35d9c72a6.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_f2caa211d75568ccac8428c35d9c72a6.jpg saved to cache
2026-03-28 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d472da71-a6c3-5c89-bdce-60574e916ef6
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc553490>
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d472da71-a6c3-5c89-bdce-60574e916ef6/d472da71-a6c3-5c89-bdce-60574e916ef6_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F41%252Fa3417e2d2250c2a9e15051ebef8fc35d%252Fpa%252FEW38815_a310fbeeb776d7b32f4777e9f5a93c49.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_a310fbeeb776d7b32f4777e9f5a93c49.jpg saved to cache
2026-03-28 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d472da71-a6c3-5c89-bdce-60574e916ef6
2026-03-28 12:07:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc55a0d0>
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fe6e99e-badc-5a01-b97a-b1995e889268/3fe6e99e-badc-5a01-b97a-b1995e889268_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F5d%252Ffe5d347cc4d8d62ce9f1d80b0f488196%252Fpa%252FVK29965_cf5c67e4c7875dcde71426b2c79beba6.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_cf5c67e4c7875dcde71426b2c79beba6.jpg saved to cache
2026-03-28 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3fe6e99e-badc-5a01-b97a-b1995e889268
2026-03-28 12:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_17d9a0c9365838ff8ba64023379afe42.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_fd2c7924ce868822ead29c7f6059be1f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_469ea1bf1808bdf309922331e09c8742.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/9b/6d9bfe21368a46de67cc985ae04391b0/pa/ZD86423_4f5597048d518ceb7bddce52301e7e67.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd149e10>
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8833348-1720-55ca-b6c9-4f7063df27ca/f8833348-1720-55ca-b6c9-4f7063df27ca_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F4a%252Fe44ade93b93c16445c4baad3edcc3798%252Fpa%252FGC10643_eb79a810eef62b328da0768ab9ffae74.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_eb79a810eef62b328da0768ab9ffae74.jpg saved to cache
2026-03-28 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f8833348-1720-55ca-b6c9-4f7063df27ca
2026-03-28 12:07:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc389c50>
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fe6e99e-badc-5a01-b97a-b1995e889268/3fe6e99e-badc-5a01-b97a-b1995e889268_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F5d%252Ffe5d347cc4d8d62ce9f1d80b0f488196%252Fpa%252FVK29965_e709423516b615a2a169576c83b0f438.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_e709423516b615a2a169576c83b0f438.jpg saved to cache
2026-03-28 12:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3fe6e99e-badc-5a01-b97a-b1995e889268
2026-03-28 12:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/84/32844bd0dd24b1becc05f9339aaec745/pa/EX32240_cb07f4ecb84df9cdeeba2a71afe19251.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf36510>
2026-03-28 12:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d472da71-a6c3-5c89-bdce-60574e916ef6/d472da71-a6c3-5c89-bdce-60574e916ef6_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F41%252Fa3417e2d2250c2a9e15051ebef8fc35d%252Fpa%252FEW38815_17d9a0c9365838ff8ba64023379afe42.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_17d9a0c9365838ff8ba64023379afe42.jpg saved to cache
2026-03-28 12:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d472da71-a6c3-5c89-bdce-60574e916ef6
2026-03-28 12:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc54df50>
2026-03-28 12:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d472da71-a6c3-5c89-bdce-60574e916ef6/d472da71-a6c3-5c89-bdce-60574e916ef6_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F41%252Fa3417e2d2250c2a9e15051ebef8fc35d%252Fpa%252FEW38815_fd2c7924ce868822ead29c7f6059be1f.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_fd2c7924ce868822ead29c7f6059be1f.jpg saved to cache
2026-03-28 12:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d472da71-a6c3-5c89-bdce-60574e916ef6
2026-03-28 12:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf46ad0>
2026-03-28 12:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d472da71-a6c3-5c89-bdce-60574e916ef6/d472da71-a6c3-5c89-bdce-60574e916ef6_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F41%252Fa3417e2d2250c2a9e15051ebef8fc35d%252Fpa%252FEW38815_469ea1bf1808bdf309922331e09c8742.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_469ea1bf1808bdf309922331e09c8742.jpg saved to cache
2026-03-28 12:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d472da71-a6c3-5c89-bdce-60574e916ef6
2026-03-28 12:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_bddfc78bbf6392eefe2bbd25bbd46328.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_53724fe7b7dac45fdf7958f3cbdf95fd.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3957d0>
2026-03-28 12:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0ce13e-15ea-593a-b11d-05bedfd3bf68/ee0ce13e-15ea-593a-b11d-05bedfd3bf68_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F9b%252F6d9bfe21368a46de67cc985ae04391b0%252Fpa%252FZD86423_4f5597048d518ceb7bddce52301e7e67.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/9b/6d9bfe21368a46de67cc985ae04391b0/pa/ZD86423_4f5597048d518ceb7bddce52301e7e67.jpg saved to cache
2026-03-28 12:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee0ce13e-15ea-593a-b11d-05bedfd3bf68
2026-03-28 12:07:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee0ce13e-15ea-593a-b11d-05bedfd3bf68, skipping ID generation
2026-03-28 12:07:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee0ce13e-15ea-593a-b11d-05bedfd3bf68 with scrape type 1
2026-03-28 12:07:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee0ce13e-15ea-593a-b11d-05bedfd3bf68 sending to next pipeline
2026-03-28 12:07:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ee0ce13e-15ea-593a-b11d-05bedfd3bf68, identifier: ZD86423
2026-03-28 12:07:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ee0ce13e-15ea-593a-b11d-05bedfd3bf68 with identifier: ZD86423
2026-03-28 12:07:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ee0ce13e-15ea-593a-b11d-05bedfd3bf68 with identifier: ZD86423
2026-03-28 12:07:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ee0ce13e-15ea-593a-b11d-05bedfd3bf68 with identifier: ZD86423 to the API
2026-03-28 12:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6d/9b/6d9bfe21368a46de67cc985ae04391b0/pa/ZD86423_4f5597048d518ceb7bddce52301e7e67.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:57:18Z',
 'fuel_type': 'petrol',
 'id': 'ee0ce13e-15ea-593a-b11d-05bedfd3bf68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD86423',
 'listing': 'auction',
 'location': 'IT, Roma RM',
 'make': 'Renault',
 'model': 'Modus',
 'odometer': 154923,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0ce13e-15ea-593a-b11d-05bedfd3bf68/ee0ce13e-15ea-593a-b11d-05bedfd3bf68_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/9b/6d9bfe21368a46de67cc985ae04391b0/pa/ZD86423_4f5597048d518ceb7bddce52301e7e67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0ce13e-15ea-593a-b11d-05bedfd3bf68/ee0ce13e-15ea-593a-b11d-05bedfd3bf68_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/9b/6d9bfe21368a46de67cc985ae04391b0/pa/ZD86423_cc76c8cd233fa3afecad15c9a79bcd26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0ce13e-15ea-593a-b11d-05bedfd3bf68/ee0ce13e-15ea-593a-b11d-05bedfd3bf68_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/9b/6d9bfe21368a46de67cc985ae04391b0/pa/ZD86423_00fe062ed2bd03c3808ea9ea4cf7e111.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0ce13e-15ea-593a-b11d-05bedfd3bf68/ee0ce13e-15ea-593a-b11d-05bedfd3bf68_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/9b/6d9bfe21368a46de67cc985ae04391b0/pa/ZD86423_4e24709eb099def06a65ddbe8e066a03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0ce13e-15ea-593a-b11d-05bedfd3bf68/ee0ce13e-15ea-593a-b11d-05bedfd3bf68_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/9b/6d9bfe21368a46de67cc985ae04391b0/pa/ZD86423_eb39ab04688d61639a58b8f25db63851.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Modus 1.2 Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2009}
2026-03-28 12:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD86423%27 HTTP/1.1" 200 None
2026-03-28 12:07:10 [auto1.it] INFO: Saving data for ZD86423: {'created_time': 1774699630.225043, 'last_price_update_time': 1774699630.225056, 'auction_closing_time': 1774886238.0}
2026-03-28 12:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZD86423') HTTP/1.1" 204 0
2026-03-28 12:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf88c10>
2026-03-28 12:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcb2ce7c-b744-5815-982d-b1f51c9d812b/dcb2ce7c-b744-5815-982d-b1f51c9d812b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F84%252F32844bd0dd24b1becc05f9339aaec745%252Fpa%252FEX32240_cb07f4ecb84df9cdeeba2a71afe19251.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/84/32844bd0dd24b1becc05f9339aaec745/pa/EX32240_cb07f4ecb84df9cdeeba2a71afe19251.jpg saved to cache
2026-03-28 12:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dcb2ce7c-b744-5815-982d-b1f51c9d812b
2026-03-28 12:07:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dcb2ce7c-b744-5815-982d-b1f51c9d812b, skipping ID generation
2026-03-28 12:07:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcb2ce7c-b744-5815-982d-b1f51c9d812b with scrape type 1
2026-03-28 12:07:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dcb2ce7c-b744-5815-982d-b1f51c9d812b sending to next pipeline
2026-03-28 12:07:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dcb2ce7c-b744-5815-982d-b1f51c9d812b, identifier: EX32240
2026-03-28 12:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dcb2ce7c-b744-5815-982d-b1f51c9d812b with identifier: EX32240
2026-03-28 12:07:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dcb2ce7c-b744-5815-982d-b1f51c9d812b with identifier: EX32240
2026-03-28 12:07:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dcb2ce7c-b744-5815-982d-b1f51c9d812b with identifier: EX32240 to the API
2026-03-28 12:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img32/84/32844bd0dd24b1becc05f9339aaec745/pa/EX32240_cb07f4ecb84df9cdeeba2a71afe19251.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:31:58Z',
 'fuel_type': 'diesel',
 'id': 'dcb2ce7c-b744-5815-982d-b1f51c9d812b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX32240',
 'listing': 'auction',
 'location': 'IT, Villasanta',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 222668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb2ce7c-b744-5815-982d-b1f51c9d812b/dcb2ce7c-b744-5815-982d-b1f51c9d812b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84997,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/84/32844bd0dd24b1becc05f9339aaec745/pa/EX32240_cb07f4ecb84df9cdeeba2a71afe19251.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb2ce7c-b744-5815-982d-b1f51c9d812b/dcb2ce7c-b744-5815-982d-b1f51c9d812b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/84/32844bd0dd24b1becc05f9339aaec745/pa/EX32240_5a81342aa0cfe88636451819486c99ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb2ce7c-b744-5815-982d-b1f51c9d812b/dcb2ce7c-b744-5815-982d-b1f51c9d812b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/84/32844bd0dd24b1becc05f9339aaec745/pa/EX32240_4d5bbbd44af92aae3a0fcf39197cbba7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb2ce7c-b744-5815-982d-b1f51c9d812b/dcb2ce7c-b744-5815-982d-b1f51c9d812b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/84/32844bd0dd24b1becc05f9339aaec745/pa/EX32240_46971d3126890995022190dc6558ff4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb2ce7c-b744-5815-982d-b1f51c9d812b/dcb2ce7c-b744-5815-982d-b1f51c9d812b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69207,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/84/32844bd0dd24b1becc05f9339aaec745/pa/EX32240_30b5625a135b8e456e34db4d008adc6a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500L 1.3 M-Jet Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2017}
2026-03-28 12:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EX32240%27 HTTP/1.1" 200 None
2026-03-28 12:07:10 [auto1.it] INFO: Saving data for EX32240: {'created_time': 1774699630.910071, 'last_price_update_time': 1774699630.910081, 'auction_closing_time': 1774884718.0}
2026-03-28 12:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EX32240') HTTP/1.1" 204 0
2026-03-28 12:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd149d10>
2026-03-28 12:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8833348-1720-55ca-b6c9-4f7063df27ca/f8833348-1720-55ca-b6c9-4f7063df27ca_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F4a%252Fe44ade93b93c16445c4baad3edcc3798%252Fpa%252FGC10643_bddfc78bbf6392eefe2bbd25bbd46328.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_bddfc78bbf6392eefe2bbd25bbd46328.jpg saved to cache
2026-03-28 12:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f8833348-1720-55ca-b6c9-4f7063df27ca
2026-03-28 12:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfb0c10>
2026-03-28 12:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8833348-1720-55ca-b6c9-4f7063df27ca/f8833348-1720-55ca-b6c9-4f7063df27ca_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F4a%252Fe44ade93b93c16445c4baad3edcc3798%252Fpa%252FGC10643_53724fe7b7dac45fdf7958f3cbdf95fd.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_53724fe7b7dac45fdf7958f3cbdf95fd.jpg saved to cache
2026-03-28 12:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f8833348-1720-55ca-b6c9-4f7063df27ca
2026-03-28 12:07:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f8833348-1720-55ca-b6c9-4f7063df27ca, skipping ID generation
2026-03-28 12:07:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8833348-1720-55ca-b6c9-4f7063df27ca with scrape type 1
2026-03-28 12:07:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8833348-1720-55ca-b6c9-4f7063df27ca sending to next pipeline
2026-03-28 12:07:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f8833348-1720-55ca-b6c9-4f7063df27ca, identifier: GC10643
2026-03-28 12:07:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f8833348-1720-55ca-b6c9-4f7063df27ca with identifier: GC10643
2026-03-28 12:07:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f8833348-1720-55ca-b6c9-4f7063df27ca with identifier: GC10643
2026-03-28 12:07:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f8833348-1720-55ca-b6c9-4f7063df27ca with identifier: GC10643 to the API
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_53724fe7b7dac45fdf7958f3cbdf95fd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:11:49Z',
 'fuel_type': 'diesel',
 'id': 'f8833348-1720-55ca-b6c9-4f7063df27ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC10643',
 'listing': 'auction',
 'location': 'IT, Bologna',
 'make': 'Hyundai',
 'model': 'ix20',
 'odometer': 115382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8833348-1720-55ca-b6c9-4f7063df27ca/f8833348-1720-55ca-b6c9-4f7063df27ca_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_7cd50d4f820db1ae1c2612fbb8aba618.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8833348-1720-55ca-b6c9-4f7063df27ca/f8833348-1720-55ca-b6c9-4f7063df27ca_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_3f14c0c5ad656064bf5e7d9509945c94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8833348-1720-55ca-b6c9-4f7063df27ca/f8833348-1720-55ca-b6c9-4f7063df27ca_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61074,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_f2b3cefa59715d39cd8f2f3e575b6bd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8833348-1720-55ca-b6c9-4f7063df27ca/f8833348-1720-55ca-b6c9-4f7063df27ca_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_7e892045ca236d898238e3a4ae43401b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8833348-1720-55ca-b6c9-4f7063df27ca/f8833348-1720-55ca-b6c9-4f7063df27ca_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_671b2646708502b048911dcb777be90c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8833348-1720-55ca-b6c9-4f7063df27ca/f8833348-1720-55ca-b6c9-4f7063df27ca_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_4096d3f314c78c38fb04201be86e4abc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8833348-1720-55ca-b6c9-4f7063df27ca/f8833348-1720-55ca-b6c9-4f7063df27ca_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_bddfc78bbf6392eefe2bbd25bbd46328.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8833348-1720-55ca-b6c9-4f7063df27ca/f8833348-1720-55ca-b6c9-4f7063df27ca_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_53724fe7b7dac45fdf7958f3cbdf95fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8833348-1720-55ca-b6c9-4f7063df27ca/f8833348-1720-55ca-b6c9-4f7063df27ca_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_f18df8fed9b22b99038f34277b8ad994.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8833348-1720-55ca-b6c9-4f7063df27ca/f8833348-1720-55ca-b6c9-4f7063df27ca_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/4a/e44ade93b93c16445c4baad3edcc3798/pa/GC10643_eb79a810eef62b328da0768ab9ffae74.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-08-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai ix20 1.4 CRDi Xpossible',
 'transmission': 'manual',
 'trim': 'Xpossible',
 'year': 2016}
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC10643%27 HTTP/1.1" 200 None
2026-03-28 12:07:11 [auto1.it] INFO: Saving data for GC10643: {'created_time': 1774699631.521492, 'last_price_update_time': 1774699631.521503, 'auction_closing_time': 1774883509.0}
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GC10643') HTTP/1.1" 204 0
2026-03-28 12:07:11 [auto1.it] INFO: Channel: 24h | Page: 9 | totalHits: 3674 | hits on page: 40
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: MN96094
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: YD21144
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD21144%27 HTTP/1.1" 200 None
2026-03-28 12:07:11 [auto1.it] INFO: Scrape type for YD21144: 0
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: RT57270
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: JC99655
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC99655%27 HTTP/1.1" 200 None
2026-03-28 12:07:11 [auto1.it] INFO: Scrape type for JC99655: 0
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: YN59096
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YN59096%27 HTTP/1.1" 200 None
2026-03-28 12:07:11 [auto1.it] INFO: Scrape type for YN59096: 0
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: PC10641
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC10641%27 HTTP/1.1" 200 None
2026-03-28 12:07:11 [auto1.it] INFO: Scrape type for PC10641: 0
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: MH04778
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH04778%27 HTTP/1.1" 200 None
2026-03-28 12:07:11 [auto1.it] INFO: Scrape type for MH04778: 0
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: HG07035
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: RB57838
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: UW00940
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW00940%27 HTTP/1.1" 200 None
2026-03-28 12:07:11 [auto1.it] INFO: Scrape type for UW00940: 0
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: CR16346
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR16346%27 HTTP/1.1" 200 None
2026-03-28 12:07:11 [auto1.it] INFO: Scrape type for CR16346: 0
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: PD21393
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD21393%27 HTTP/1.1" 200 None
2026-03-28 12:07:11 [auto1.it] INFO: Scrape type for PD21393: 0
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: AU50392
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: XK62729
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XK62729%27 HTTP/1.1" 200 None
2026-03-28 12:07:11 [auto1.it] INFO: Scrape type for XK62729: 0
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: BD17279
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD17279%27 HTTP/1.1" 200 None
2026-03-28 12:07:11 [auto1.it] INFO: Scrape type for BD17279: 0
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: VV69855
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: WP22813
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: PZ74443
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ74443%27 HTTP/1.1" 200 None
2026-03-28 12:07:11 [auto1.it] INFO: Scrape type for PZ74443: 0
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: DF91853
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF91853%27 HTTP/1.1" 200 None
2026-03-28 12:07:11 [auto1.it] INFO: Scrape type for DF91853: 0
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: KA05234
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: NA17081
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: XL36522
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: WJ93918
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: PW21371
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: TR54078
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TR54078%27 HTTP/1.1" 200 None
2026-03-28 12:07:11 [auto1.it] INFO: Scrape type for TR54078: 0
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: LG70821
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG70821%27 HTTP/1.1" 200 None
2026-03-28 12:07:11 [auto1.it] INFO: Scrape type for LG70821: 0
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: TL02972
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: PD30072
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD30072%27 HTTP/1.1" 200 None
2026-03-28 12:07:11 [auto1.it] INFO: Scrape type for PD30072: 0
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: PN93360
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN93360%27 HTTP/1.1" 200 None
2026-03-28 12:07:11 [auto1.it] INFO: Scrape type for PN93360: 0
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: WH30921
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: WC55302
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: GP46420
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GP46420%27 HTTP/1.1" 200 None
2026-03-28 12:07:11 [auto1.it] INFO: Scrape type for GP46420: 0
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: LD02725
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: SB80667
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: HW51602
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: DX75497
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX75497%27 HTTP/1.1" 200 None
2026-03-28 12:07:11 [auto1.it] INFO: Scrape type for DX75497: 0
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: KF97174
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: UT33269
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: GJ33186
2026-03-28 12:07:11 [auto1.it] INFO: Found listing with ID: CJ50775
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CJ50775%27 HTTP/1.1" 200 None
2026-03-28 12:07:11 [auto1.it] INFO: Scrape type for CJ50775: 0
2026-03-28 12:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_e76b05a98986912f836abf8455de1e7a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_3c5d94145c8ce840dcc8fb0ae82e5b81.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_7be50a3e25d4015749ed4f853249b134.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_454bd6223551c6e3da153266c3be9842.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_58f294f5f00d7fb77e6f470df98a500c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_d1b3d750a383c0aa53291893d290a8f2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_2269cc5d6ecaccde6fc6363c142a97f3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_945c193ca19558f4bc358fc3156713df.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bf1bd6d0>
2026-03-28 12:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d472da71-a6c3-5c89-bdce-60574e916ef6/d472da71-a6c3-5c89-bdce-60574e916ef6_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F41%252Fa3417e2d2250c2a9e15051ebef8fc35d%252Fpa%252FEW38815_e76b05a98986912f836abf8455de1e7a.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_e76b05a98986912f836abf8455de1e7a.jpg saved to cache
2026-03-28 12:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d472da71-a6c3-5c89-bdce-60574e916ef6
2026-03-28 12:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_e273b381e53d46ff9c1ab26632080c1b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_d33315daa1e0364eca77cb5f3218c2cc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_c4546f9a0f561506b6a6c5b4f978f798.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc2a9d10>
2026-03-28 12:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d472da71-a6c3-5c89-bdce-60574e916ef6/d472da71-a6c3-5c89-bdce-60574e916ef6_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F41%252Fa3417e2d2250c2a9e15051ebef8fc35d%252Fpa%252FEW38815_3c5d94145c8ce840dcc8fb0ae82e5b81.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_3c5d94145c8ce840dcc8fb0ae82e5b81.jpg saved to cache
2026-03-28 12:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d472da71-a6c3-5c89-bdce-60574e916ef6
2026-03-28 12:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bf1c1710>
2026-03-28 12:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d472da71-a6c3-5c89-bdce-60574e916ef6/d472da71-a6c3-5c89-bdce-60574e916ef6_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F41%252Fa3417e2d2250c2a9e15051ebef8fc35d%252Fpa%252FEW38815_7be50a3e25d4015749ed4f853249b134.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_7be50a3e25d4015749ed4f853249b134.jpg saved to cache
2026-03-28 12:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d472da71-a6c3-5c89-bdce-60574e916ef6
2026-03-28 12:07:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d472da71-a6c3-5c89-bdce-60574e916ef6, skipping ID generation
2026-03-28 12:07:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d472da71-a6c3-5c89-bdce-60574e916ef6 with scrape type 1
2026-03-28 12:07:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d472da71-a6c3-5c89-bdce-60574e916ef6 sending to next pipeline
2026-03-28 12:07:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d472da71-a6c3-5c89-bdce-60574e916ef6, identifier: EW38815
2026-03-28 12:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc486610>
2026-03-28 12:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3274a6e0-0b1a-5aba-a406-beb335beeeee/3274a6e0-0b1a-5aba-a406-beb335beeeee_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F6c%252Fb06c97d8b1deae9be098e8feb68c95cf%252Fpa%252FKV81214_454bd6223551c6e3da153266c3be9842.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_454bd6223551c6e3da153266c3be9842.jpg saved to cache
2026-03-28 12:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3274a6e0-0b1a-5aba-a406-beb335beeeee
2026-03-28 12:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfe5a50>
2026-03-28 12:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fd24d2e-c7a4-5e24-94aa-abb81314b2a2/7fd24d2e-c7a4-5e24-94aa-abb81314b2a2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F4d%252F5c4dda21beac1477e02dd63c090b78c9%252Fpa%252FVU78996_58f294f5f00d7fb77e6f470df98a500c.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_58f294f5f00d7fb77e6f470df98a500c.jpg saved to cache
2026-03-28 12:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7fd24d2e-c7a4-5e24-94aa-abb81314b2a2
2026-03-28 12:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5d7410>
2026-03-28 12:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f029de87-54cc-51b1-8c8d-319621cad535/f029de87-54cc-51b1-8c8d-319621cad535_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fb0%252Fb3b0d4d0286d40b9f3b56936f868c1cd%252Fpa%252FSS75136_d1b3d750a383c0aa53291893d290a8f2.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_d1b3d750a383c0aa53291893d290a8f2.jpg saved to cache
2026-03-28 12:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f029de87-54cc-51b1-8c8d-319621cad535
2026-03-28 12:07:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f029de87-54cc-51b1-8c8d-319621cad535, skipping ID generation
2026-03-28 12:07:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f029de87-54cc-51b1-8c8d-319621cad535 with scrape type 1
2026-03-28 12:07:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f029de87-54cc-51b1-8c8d-319621cad535 sending to next pipeline
2026-03-28 12:07:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f029de87-54cc-51b1-8c8d-319621cad535, identifier: SS75136
2026-03-28 12:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc544510>
2026-03-28 12:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fe6e99e-badc-5a01-b97a-b1995e889268/3fe6e99e-badc-5a01-b97a-b1995e889268_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F5d%252Ffe5d347cc4d8d62ce9f1d80b0f488196%252Fpa%252FVK29965_2269cc5d6ecaccde6fc6363c142a97f3.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_2269cc5d6ecaccde6fc6363c142a97f3.jpg saved to cache
2026-03-28 12:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3fe6e99e-badc-5a01-b97a-b1995e889268
2026-03-28 12:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5e5310>
2026-03-28 12:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fe6e99e-badc-5a01-b97a-b1995e889268/3fe6e99e-badc-5a01-b97a-b1995e889268_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F5d%252Ffe5d347cc4d8d62ce9f1d80b0f488196%252Fpa%252FVK29965_945c193ca19558f4bc358fc3156713df.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_945c193ca19558f4bc358fc3156713df.jpg saved to cache
2026-03-28 12:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3fe6e99e-badc-5a01-b97a-b1995e889268
2026-03-28 12:07:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3fe6e99e-badc-5a01-b97a-b1995e889268, skipping ID generation
2026-03-28 12:07:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fe6e99e-badc-5a01-b97a-b1995e889268 with scrape type 1
2026-03-28 12:07:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3fe6e99e-badc-5a01-b97a-b1995e889268 sending to next pipeline
2026-03-28 12:07:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3fe6e99e-badc-5a01-b97a-b1995e889268, identifier: VK29965
2026-03-28 12:07:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d472da71-a6c3-5c89-bdce-60574e916ef6 with identifier: EW38815
2026-03-28 12:07:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d472da71-a6c3-5c89-bdce-60574e916ef6 with identifier: EW38815
2026-03-28 12:07:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d472da71-a6c3-5c89-bdce-60574e916ef6 with identifier: EW38815 to the API
2026-03-28 12:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_7be50a3e25d4015749ed4f853249b134.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:43:16Z',
 'fuel_type': 'gas',
 'id': 'd472da71-a6c3-5c89-bdce-60574e916ef6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW38815',
 'listing': 'auction',
 'location': 'IT, Cesena',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 149857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d472da71-a6c3-5c89-bdce-60574e916ef6/d472da71-a6c3-5c89-bdce-60574e916ef6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1999259,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_e76b05a98986912f836abf8455de1e7a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d472da71-a6c3-5c89-bdce-60574e916ef6/d472da71-a6c3-5c89-bdce-60574e916ef6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_f2caa211d75568ccac8428c35d9c72a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d472da71-a6c3-5c89-bdce-60574e916ef6/d472da71-a6c3-5c89-bdce-60574e916ef6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62301,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_c1dc91bceb88148c29b46388e5804494.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d472da71-a6c3-5c89-bdce-60574e916ef6/d472da71-a6c3-5c89-bdce-60574e916ef6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_d2482cd0d04fbb0d70dd7d648c452442.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d472da71-a6c3-5c89-bdce-60574e916ef6/d472da71-a6c3-5c89-bdce-60574e916ef6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1854452,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_3c5d94145c8ce840dcc8fb0ae82e5b81.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d472da71-a6c3-5c89-bdce-60574e916ef6/d472da71-a6c3-5c89-bdce-60574e916ef6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_a310fbeeb776d7b32f4777e9f5a93c49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d472da71-a6c3-5c89-bdce-60574e916ef6/d472da71-a6c3-5c89-bdce-60574e916ef6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_17d9a0c9365838ff8ba64023379afe42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d472da71-a6c3-5c89-bdce-60574e916ef6/d472da71-a6c3-5c89-bdce-60574e916ef6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1922651,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_7be50a3e25d4015749ed4f853249b134.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d472da71-a6c3-5c89-bdce-60574e916ef6/d472da71-a6c3-5c89-bdce-60574e916ef6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_fd2c7924ce868822ead29c7f6059be1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d472da71-a6c3-5c89-bdce-60574e916ef6/d472da71-a6c3-5c89-bdce-60574e916ef6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/41/a3417e2d2250c2a9e15051ebef8fc35d/pa/EW38815_469ea1bf1808bdf309922331e09c8742.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford C-Max 1.6 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2014}
2026-03-28 12:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW38815%27 HTTP/1.1" 200 None
2026-03-28 12:07:13 [auto1.it] INFO: Saving data for EW38815: {'created_time': 1774699633.679155, 'last_price_update_time': 1774699633.679165, 'auction_closing_time': 1774885396.0}
2026-03-28 12:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EW38815') HTTP/1.1" 204 0
2026-03-28 12:07:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f029de87-54cc-51b1-8c8d-319621cad535 with identifier: SS75136
2026-03-28 12:07:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f029de87-54cc-51b1-8c8d-319621cad535 with identifier: SS75136
2026-03-28 12:07:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f029de87-54cc-51b1-8c8d-319621cad535 with identifier: SS75136 to the API
2026-03-28 12:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_d1b3d750a383c0aa53291893d290a8f2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.1L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:18:58Z',
 'fuel_type': 'diesel',
 'id': 'f029de87-54cc-51b1-8c8d-319621cad535',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS75136',
 'listing': 'auction',
 'location': 'IT, Napoli',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 168046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f029de87-54cc-51b1-8c8d-319621cad535/f029de87-54cc-51b1-8c8d-319621cad535_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_20ed99a0b653008cc237f47600d855ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f029de87-54cc-51b1-8c8d-319621cad535/f029de87-54cc-51b1-8c8d-319621cad535_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_eab79dba74b5e6575191c235d869224b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f029de87-54cc-51b1-8c8d-319621cad535/f029de87-54cc-51b1-8c8d-319621cad535_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2992014,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_d1b3d750a383c0aa53291893d290a8f2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f029de87-54cc-51b1-8c8d-319621cad535/f029de87-54cc-51b1-8c8d-319621cad535_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63181,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_17db58fae5ddc941f45703fc5c4ab163.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f029de87-54cc-51b1-8c8d-319621cad535/f029de87-54cc-51b1-8c8d-319621cad535_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3070703,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_1948fdafc845c32403f578217a760f91.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f029de87-54cc-51b1-8c8d-319621cad535/f029de87-54cc-51b1-8c8d-319621cad535_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_6e3b980670d947ecd51ecad0506fa912.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f029de87-54cc-51b1-8c8d-319621cad535/f029de87-54cc-51b1-8c8d-319621cad535_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_308cf5925afabb67e27da5422d5cbac2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f029de87-54cc-51b1-8c8d-319621cad535/f029de87-54cc-51b1-8c8d-319621cad535_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_fb23d814b347b581fb63f0d74060698e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f029de87-54cc-51b1-8c8d-319621cad535/f029de87-54cc-51b1-8c8d-319621cad535_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_ab7c7e554423d05dbc5d3751337fda6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f029de87-54cc-51b1-8c8d-319621cad535/f029de87-54cc-51b1-8c8d-319621cad535_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56815,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/b0/b3b0d4d0286d40b9f3b56936f868c1cd/pa/SS75136_7e760d2dace710342aa0f65346382c3f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Compass 2.2 CRD Limited 4x4',
 'transmission': 'manual',
 'trim': 'Limited 4x4',
 'year': 2011}
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS75136%27 HTTP/1.1" 200 None
2026-03-28 12:07:14 [auto1.it] INFO: Saving data for SS75136: {'created_time': 1774699634.108063, 'last_price_update_time': 1774699634.108073, 'auction_closing_time': 1774883938.0}
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SS75136') HTTP/1.1" 204 0
2026-03-28 12:07:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3fe6e99e-badc-5a01-b97a-b1995e889268 with identifier: VK29965
2026-03-28 12:07:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3fe6e99e-badc-5a01-b97a-b1995e889268 with identifier: VK29965
2026-03-28 12:07:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3fe6e99e-badc-5a01-b97a-b1995e889268 with identifier: VK29965 to the API
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_945c193ca19558f4bc358fc3156713df.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 230,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:36:46Z',
 'fuel_type': 'diesel',
 'id': '3fe6e99e-badc-5a01-b97a-b1995e889268',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK29965',
 'listing': 'auction',
 'location': 'IT, Palermo',
 'make': 'Volkswagen',
 'model': 'Amarok',
 'odometer': 115900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fe6e99e-badc-5a01-b97a-b1995e889268/3fe6e99e-badc-5a01-b97a-b1995e889268_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_9c80714926174d47343860604ab8f889.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fe6e99e-badc-5a01-b97a-b1995e889268/3fe6e99e-badc-5a01-b97a-b1995e889268_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_897dcc516531e6d393547df5ff8bc0e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fe6e99e-badc-5a01-b97a-b1995e889268/3fe6e99e-badc-5a01-b97a-b1995e889268_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_cc32534b9feb210919e6dca30a990a6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fe6e99e-badc-5a01-b97a-b1995e889268/3fe6e99e-badc-5a01-b97a-b1995e889268_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3224931,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_945c193ca19558f4bc358fc3156713df.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fe6e99e-badc-5a01-b97a-b1995e889268/3fe6e99e-badc-5a01-b97a-b1995e889268_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3428269,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_6a7e050e9cd489e1e892f1ef0744dc8c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fe6e99e-badc-5a01-b97a-b1995e889268/3fe6e99e-badc-5a01-b97a-b1995e889268_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3569841,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_e709423516b615a2a169576c83b0f438.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fe6e99e-badc-5a01-b97a-b1995e889268/3fe6e99e-badc-5a01-b97a-b1995e889268_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_975a16d43c671b257f9ecb88481e8fd7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fe6e99e-badc-5a01-b97a-b1995e889268/3fe6e99e-badc-5a01-b97a-b1995e889268_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3235040,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_2269cc5d6ecaccde6fc6363c142a97f3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fe6e99e-badc-5a01-b97a-b1995e889268/3fe6e99e-badc-5a01-b97a-b1995e889268_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3233992,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_cf5c67e4c7875dcde71426b2c79beba6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fe6e99e-badc-5a01-b97a-b1995e889268/3fe6e99e-badc-5a01-b97a-b1995e889268_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/5d/fe5d347cc4d8d62ce9f1d80b0f488196/pa/VK29965_b5bfb56683ce2ba1627757fb2a74ade4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Amarok 2.0 TDI Life Doppelkabine 4Motion',
 'transmission': 'automatic',
 'trim': 'Life Doppelkabine 4Motion',
 'year': 2023}
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK29965%27 HTTP/1.1" 200 None
2026-03-28 12:07:14 [auto1.it] INFO: Saving data for VK29965: {'created_time': 1774699634.505205, 'last_price_update_time': 1774699634.505215, 'auction_closing_time': 1774885006.0}
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VK29965') HTTP/1.1" 204 0
2026-03-28 12:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AY38539> (referer: https://www.auto1.com/v1/car-details-view/AY38539/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc2d0750>
2026-03-28 12:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fd24d2e-c7a4-5e24-94aa-abb81314b2a2/7fd24d2e-c7a4-5e24-94aa-abb81314b2a2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F4d%252F5c4dda21beac1477e02dd63c090b78c9%252Fpa%252FVU78996_e273b381e53d46ff9c1ab26632080c1b.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_e273b381e53d46ff9c1ab26632080c1b.jpg saved to cache
2026-03-28 12:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7fd24d2e-c7a4-5e24-94aa-abb81314b2a2
2026-03-28 12:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd070050>
2026-03-28 12:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_226ea16f-8e4c-5c8c-8029-e732542d307f/226ea16f-8e4c-5c8c-8029-e732542d307f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F38%252F40380e14f263dd4a58844d0c434613aa%252Fpa%252FPR73005_d33315daa1e0364eca77cb5f3218c2cc.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_d33315daa1e0364eca77cb5f3218c2cc.jpg saved to cache
2026-03-28 12:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 226ea16f-8e4c-5c8c-8029-e732542d307f
2026-03-28 12:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bef20490>
2026-03-28 12:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3274a6e0-0b1a-5aba-a406-beb335beeeee/3274a6e0-0b1a-5aba-a406-beb335beeeee_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F6c%252Fb06c97d8b1deae9be098e8feb68c95cf%252Fpa%252FKV81214_c4546f9a0f561506b6a6c5b4f978f798.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_c4546f9a0f561506b6a6c5b4f978f798.jpg saved to cache
2026-03-28 12:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3274a6e0-0b1a-5aba-a406-beb335beeeee
2026-03-28 12:07:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 984e52a1-fc86-5f11-9a48-d70cb58b60a3 with identifier: AY38539
2026-03-28 12:07:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 984e52a1-fc86-5f11-9a48-d70cb58b60a3 with scrape type 1
2026-03-28 12:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 984e52a1-fc86-5f11-9a48-d70cb58b60a3
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa6%252F5aa609807bc99237ce8284e99d0db3e2%252Fpa%252FAY38539_25793dbdc70b32490c385197528b2ce4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a6/5aa609807bc99237ce8284e99d0db3e2/pa/AY38539_25793dbdc70b32490c385197528b2ce4.jpg already downloaded
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa6%252F5aa609807bc99237ce8284e99d0db3e2%252Fpa%252FAY38539_a718023ce55a47cf67771914030af133.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a6/5aa609807bc99237ce8284e99d0db3e2/pa/AY38539_a718023ce55a47cf67771914030af133.jpg already downloaded
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa6%252F5aa609807bc99237ce8284e99d0db3e2%252Fpa%252FAY38539_68772dcf205e162e8d801be4dcf194e5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a6/5aa609807bc99237ce8284e99d0db3e2/pa/AY38539_68772dcf205e162e8d801be4dcf194e5.jpg already downloaded
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa6%252F5aa609807bc99237ce8284e99d0db3e2%252Fpa%252FAY38539_6453629f5dcfc786fbed61b3283bd23f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a6/5aa609807bc99237ce8284e99d0db3e2/pa/AY38539_6453629f5dcfc786fbed61b3283bd23f.jpg already downloaded
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa6%252F5aa609807bc99237ce8284e99d0db3e2%252Fpa%252FAY38539_e67fb8450633b22e57727e9b72363289.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a6/5aa609807bc99237ce8284e99d0db3e2/pa/AY38539_e67fb8450633b22e57727e9b72363289.jpg already downloaded
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa6%252F5aa609807bc99237ce8284e99d0db3e2%252Fpa%252FAY38539_df075d8a94da63ca4f07481d054f927d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a6/5aa609807bc99237ce8284e99d0db3e2/pa/AY38539_df075d8a94da63ca4f07481d054f927d.jpg already downloaded
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa6%252F5aa609807bc99237ce8284e99d0db3e2%252Fpa%252FAY38539_e3e09c86306cb0acd0a263582c3a2449.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a6/5aa609807bc99237ce8284e99d0db3e2/pa/AY38539_e3e09c86306cb0acd0a263582c3a2449.jpg already downloaded
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa6%252F5aa609807bc99237ce8284e99d0db3e2%252Fpa%252FAY38539_abd893864945e5c09251ea33f66d35ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a6/5aa609807bc99237ce8284e99d0db3e2/pa/AY38539_abd893864945e5c09251ea33f66d35ad.jpg already downloaded
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa6%252F5aa609807bc99237ce8284e99d0db3e2%252Fpa%252FAY38539_0e96cbe0a300c4e1e790b6059f0ec27b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a6/5aa609807bc99237ce8284e99d0db3e2/pa/AY38539_0e96cbe0a300c4e1e790b6059f0ec27b.jpg already downloaded
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa6%252F5aa609807bc99237ce8284e99d0db3e2%252Fpa%252FAY38539_5b56240b48d3c4441f115700c8455ece.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a6/5aa609807bc99237ce8284e99d0db3e2/pa/AY38539_5b56240b48d3c4441f115700c8455ece.jpg already downloaded
2026-03-28 12:07:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 984e52a1-fc86-5f11-9a48-d70cb58b60a3, identifier: AY38539
2026-03-28 12:07:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 984e52a1-fc86-5f11-9a48-d70cb58b60a3 with identifier: AY38539
2026-03-28 12:07:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 984e52a1-fc86-5f11-9a48-d70cb58b60a3 with identifier: AY38539
2026-03-28 12:07:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 984e52a1-fc86-5f11-9a48-d70cb58b60a3 with identifier: AY38539 to the API
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AY38539>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:26:14Z',
 'fuel_type': 'petrol',
 'id': '984e52a1-fc86-5f11-9a48-d70cb58b60a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY38539',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 75736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img5a/a6/5aa609807bc99237ce8284e99d0db3e2/pa/AY38539_25793dbdc70b32490c385197528b2ce4.jpg',
                'https://img-pa.auto1.com/img5a/a6/5aa609807bc99237ce8284e99d0db3e2/pa/AY38539_a718023ce55a47cf67771914030af133.jpg',
                'https://img-pa.auto1.com/img5a/a6/5aa609807bc99237ce8284e99d0db3e2/pa/AY38539_68772dcf205e162e8d801be4dcf194e5.jpg',
                'https://img-pa.auto1.com/img5a/a6/5aa609807bc99237ce8284e99d0db3e2/pa/AY38539_6453629f5dcfc786fbed61b3283bd23f.jpg',
                'https://img-pa.auto1.com/img5a/a6/5aa609807bc99237ce8284e99d0db3e2/pa/AY38539_e67fb8450633b22e57727e9b72363289.jpg',
                'https://img-pa.auto1.com/img5a/a6/5aa609807bc99237ce8284e99d0db3e2/pa/AY38539_df075d8a94da63ca4f07481d054f927d.jpg',
                'https://img-pa.auto1.com/img5a/a6/5aa609807bc99237ce8284e99d0db3e2/pa/AY38539_e3e09c86306cb0acd0a263582c3a2449.jpg',
                'https://img-pa.auto1.com/img5a/a6/5aa609807bc99237ce8284e99d0db3e2/pa/AY38539_abd893864945e5c09251ea33f66d35ad.jpg',
                'https://img-pa.auto1.com/img5a/a6/5aa609807bc99237ce8284e99d0db3e2/pa/AY38539_0e96cbe0a300c4e1e790b6059f0ec27b.jpg',
                'https://img-pa.auto1.com/img5a/a6/5aa609807bc99237ce8284e99d0db3e2/pa/AY38539_5b56240b48d3c4441f115700c8455ece.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984e52a1-fc86-5f11-9a48-d70cb58b60a3/984e52a1-fc86-5f11-9a48-d70cb58b60a3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/a6/5aa609807bc99237ce8284e99d0db3e2/pa/AY38539_25793dbdc70b32490c385197528b2ce4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984e52a1-fc86-5f11-9a48-d70cb58b60a3/984e52a1-fc86-5f11-9a48-d70cb58b60a3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3145317,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/a6/5aa609807bc99237ce8284e99d0db3e2/pa/AY38539_a718023ce55a47cf67771914030af133.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984e52a1-fc86-5f11-9a48-d70cb58b60a3/984e52a1-fc86-5f11-9a48-d70cb58b60a3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2916287,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/a6/5aa609807bc99237ce8284e99d0db3e2/pa/AY38539_68772dcf205e162e8d801be4dcf194e5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984e52a1-fc86-5f11-9a48-d70cb58b60a3/984e52a1-fc86-5f11-9a48-d70cb58b60a3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/a6/5aa609807bc99237ce8284e99d0db3e2/pa/AY38539_6453629f5dcfc786fbed61b3283bd23f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984e52a1-fc86-5f11-9a48-d70cb58b60a3/984e52a1-fc86-5f11-9a48-d70cb58b60a3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2932558,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/a6/5aa609807bc99237ce8284e99d0db3e2/pa/AY38539_e67fb8450633b22e57727e9b72363289.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984e52a1-fc86-5f11-9a48-d70cb58b60a3/984e52a1-fc86-5f11-9a48-d70cb58b60a3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/a6/5aa609807bc99237ce8284e99d0db3e2/pa/AY38539_df075d8a94da63ca4f07481d054f927d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984e52a1-fc86-5f11-9a48-d70cb58b60a3/984e52a1-fc86-5f11-9a48-d70cb58b60a3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/a6/5aa609807bc99237ce8284e99d0db3e2/pa/AY38539_e3e09c86306cb0acd0a263582c3a2449.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984e52a1-fc86-5f11-9a48-d70cb58b60a3/984e52a1-fc86-5f11-9a48-d70cb58b60a3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2796943,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/a6/5aa609807bc99237ce8284e99d0db3e2/pa/AY38539_abd893864945e5c09251ea33f66d35ad.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984e52a1-fc86-5f11-9a48-d70cb58b60a3/984e52a1-fc86-5f11-9a48-d70cb58b60a3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/a6/5aa609807bc99237ce8284e99d0db3e2/pa/AY38539_0e96cbe0a300c4e1e790b6059f0ec27b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984e52a1-fc86-5f11-9a48-d70cb58b60a3/984e52a1-fc86-5f11-9a48-d70cb58b60a3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/a6/5aa609807bc99237ce8284e99d0db3e2/pa/AY38539_5b56240b48d3c4441f115700c8455ece.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-05-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i30 1.4 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2012}
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY38539%27 HTTP/1.1" 200 None
2026-03-28 12:07:15 [auto1.it] INFO: Saving data for AY38539: {'created_time': 1774699635.236221, 'last_price_update_time': 1774699635.236231, 'auction_closing_time': 1774884374.0}
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AY38539') HTTP/1.1" 204 0
2026-03-28 12:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_719ddd68f497b64d8b212daa0e8b67b6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_68fcfa2335b45742272e2e2b334e805f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_62cefddd0b15f26c2ec5720ff3c3a195.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04beec8210>
2026-03-28 12:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_226ea16f-8e4c-5c8c-8029-e732542d307f/226ea16f-8e4c-5c8c-8029-e732542d307f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F38%252F40380e14f263dd4a58844d0c434613aa%252Fpa%252FPR73005_719ddd68f497b64d8b212daa0e8b67b6.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_719ddd68f497b64d8b212daa0e8b67b6.jpg saved to cache
2026-03-28 12:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 226ea16f-8e4c-5c8c-8029-e732542d307f
2026-03-28 12:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5d6190>
2026-03-28 12:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b60628-4f3c-5d4a-a89d-a2a00f9c5318/f6b60628-4f3c-5d4a-a89d-a2a00f9c5318_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F23%252Fae236281bbf1f5649f30d3cbb1017f93%252Fpa%252FRX99129_68fcfa2335b45742272e2e2b334e805f.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_68fcfa2335b45742272e2e2b334e805f.jpg saved to cache
2026-03-28 12:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f6b60628-4f3c-5d4a-a89d-a2a00f9c5318
2026-03-28 12:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bceab510>
2026-03-28 12:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b60628-4f3c-5d4a-a89d-a2a00f9c5318/f6b60628-4f3c-5d4a-a89d-a2a00f9c5318_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F23%252Fae236281bbf1f5649f30d3cbb1017f93%252Fpa%252FRX99129_62cefddd0b15f26c2ec5720ff3c3a195.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_62cefddd0b15f26c2ec5720ff3c3a195.jpg saved to cache
2026-03-28 12:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f6b60628-4f3c-5d4a-a89d-a2a00f9c5318
2026-03-28 12:07:15 [auto1.it] INFO: Channel: 24h | Page: 10 | totalHits: 3674 | hits on page: 40
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: YB09690
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: UC99700
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: EG31110
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: SK62476
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: KR24813
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR24813%27 HTTP/1.1" 200 None
2026-03-28 12:07:15 [auto1.it] INFO: Scrape type for KR24813: 0
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: WL53741
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: KK99486
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK99486%27 HTTP/1.1" 200 None
2026-03-28 12:07:15 [auto1.it] INFO: Scrape type for KK99486: 0
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: XW14976
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW14976%27 HTTP/1.1" 200 None
2026-03-28 12:07:15 [auto1.it] INFO: Scrape type for XW14976: 0
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: CV32353
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV32353%27 HTTP/1.1" 200 None
2026-03-28 12:07:15 [auto1.it] INFO: Scrape type for CV32353: 0
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: RB84694
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: YE49798
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YE49798%27 HTTP/1.1" 200 None
2026-03-28 12:07:15 [auto1.it] INFO: Scrape type for YE49798: 0
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: DJ31826
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: UL30423
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL30423%27 HTTP/1.1" 200 None
2026-03-28 12:07:15 [auto1.it] INFO: Scrape type for UL30423: 0
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: MT45417
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: FV07755
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: SW75734
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SW75734%27 HTTP/1.1" 200 None
2026-03-28 12:07:15 [auto1.it] INFO: Scrape type for SW75734: 0
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: HJ71706
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: XV92434
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: UK64691
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK64691%27 HTTP/1.1" 200 None
2026-03-28 12:07:15 [auto1.it] INFO: Scrape type for UK64691: 0
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: ZY56429
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: AN61279
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN61279%27 HTTP/1.1" 200 None
2026-03-28 12:07:15 [auto1.it] INFO: Scrape type for AN61279: 0
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: LT86375
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LT86375%27 HTTP/1.1" 200 None
2026-03-28 12:07:15 [auto1.it] INFO: Scrape type for LT86375: 0
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: TP07930
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: TY62021
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY62021%27 HTTP/1.1" 200 None
2026-03-28 12:07:15 [auto1.it] INFO: Scrape type for TY62021: 0
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: EH51725
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH51725%27 HTTP/1.1" 200 None
2026-03-28 12:07:15 [auto1.it] INFO: Scrape type for EH51725: 0
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: HC48656
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: NL55256
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL55256%27 HTTP/1.1" 200 None
2026-03-28 12:07:15 [auto1.it] INFO: Scrape type for NL55256: 0
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: FG90237
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: YH23554
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH23554%27 HTTP/1.1" 200 None
2026-03-28 12:07:15 [auto1.it] INFO: Scrape type for YH23554: 0
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: NK99622
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: JF19899
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: YN45355
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YN45355%27 HTTP/1.1" 200 None
2026-03-28 12:07:15 [auto1.it] INFO: Scrape type for YN45355: 0
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: GK54745
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: SR88948
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR88948%27 HTTP/1.1" 200 None
2026-03-28 12:07:15 [auto1.it] INFO: Scrape type for SR88948: 0
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: NR71125
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: NS64988
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NS64988%27 HTTP/1.1" 200 None
2026-03-28 12:07:15 [auto1.it] INFO: Scrape type for NS64988: 0
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: HT01283
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: HV13929
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HV13929%27 HTTP/1.1" 200 None
2026-03-28 12:07:15 [auto1.it] INFO: Scrape type for HV13929: 0
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: GV28161
2026-03-28 12:07:15 [auto1.it] INFO: Found listing with ID: AE80998
2026-03-28 12:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_c71be92bb040e08ef01ae7aeaa494af3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_95f17ff18251f808989bf5657d8cf257.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_84b8fd46012273fd36f29325fcf6f6ee.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_890db421af44164579b4b3a37cafd743.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_d9b3036d020384cba6103b3dbfddda97.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_c3e01b59336097fe595549c330463a56.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_793ac037ae8f610a8c2d445df8cb1ac5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_f302ab680e79024021c22b6813f8bbe7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_cecad94d2baf64cc5233136646ead31b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc4dfa10>
2026-03-28 12:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1540861-55d8-5622-83cc-65661a4f82a9/f1540861-55d8-5622-83cc-65661a4f82a9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ffa%252Fb0fa5fe76c0edb84d6f2dd581689e2ef%252Fpa%252FFR55532_c71be92bb040e08ef01ae7aeaa494af3.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_c71be92bb040e08ef01ae7aeaa494af3.jpg saved to cache
2026-03-28 12:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f1540861-55d8-5622-83cc-65661a4f82a9
2026-03-28 12:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd0fb910>
2026-03-28 12:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b7d8151-7119-57f9-be13-cd5ecb373c85/1b7d8151-7119-57f9-be13-cd5ecb373c85_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fc8%252F1ac8376a89c10f343dcbcf68449f935a%252Fpa%252FUN20093_95f17ff18251f808989bf5657d8cf257.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_95f17ff18251f808989bf5657d8cf257.jpg saved to cache
2026-03-28 12:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1b7d8151-7119-57f9-be13-cd5ecb373c85
2026-03-28 12:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc4f6750>
2026-03-28 12:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b60628-4f3c-5d4a-a89d-a2a00f9c5318/f6b60628-4f3c-5d4a-a89d-a2a00f9c5318_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F23%252Fae236281bbf1f5649f30d3cbb1017f93%252Fpa%252FRX99129_84b8fd46012273fd36f29325fcf6f6ee.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_84b8fd46012273fd36f29325fcf6f6ee.jpg saved to cache
2026-03-28 12:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f6b60628-4f3c-5d4a-a89d-a2a00f9c5318
2026-03-28 12:07:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3c8510>
2026-03-28 12:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_226ea16f-8e4c-5c8c-8029-e732542d307f/226ea16f-8e4c-5c8c-8029-e732542d307f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F38%252F40380e14f263dd4a58844d0c434613aa%252Fpa%252FPR73005_890db421af44164579b4b3a37cafd743.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_890db421af44164579b4b3a37cafd743.jpg saved to cache
2026-03-28 12:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 226ea16f-8e4c-5c8c-8029-e732542d307f
2026-03-28 12:07:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3cb9d0>
2026-03-28 12:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_226ea16f-8e4c-5c8c-8029-e732542d307f/226ea16f-8e4c-5c8c-8029-e732542d307f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F38%252F40380e14f263dd4a58844d0c434613aa%252Fpa%252FPR73005_d9b3036d020384cba6103b3dbfddda97.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_d9b3036d020384cba6103b3dbfddda97.jpg saved to cache
2026-03-28 12:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 226ea16f-8e4c-5c8c-8029-e732542d307f
2026-03-28 12:07:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 226ea16f-8e4c-5c8c-8029-e732542d307f, skipping ID generation
2026-03-28 12:07:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 226ea16f-8e4c-5c8c-8029-e732542d307f with scrape type 1
2026-03-28 12:07:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 226ea16f-8e4c-5c8c-8029-e732542d307f sending to next pipeline
2026-03-28 12:07:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 226ea16f-8e4c-5c8c-8029-e732542d307f, identifier: PR73005
2026-03-28 12:07:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcff1310>
2026-03-28 12:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3274a6e0-0b1a-5aba-a406-beb335beeeee/3274a6e0-0b1a-5aba-a406-beb335beeeee_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F6c%252Fb06c97d8b1deae9be098e8feb68c95cf%252Fpa%252FKV81214_c3e01b59336097fe595549c330463a56.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_c3e01b59336097fe595549c330463a56.jpg saved to cache
2026-03-28 12:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3274a6e0-0b1a-5aba-a406-beb335beeeee
2026-03-28 12:07:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3274a6e0-0b1a-5aba-a406-beb335beeeee, skipping ID generation
2026-03-28 12:07:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3274a6e0-0b1a-5aba-a406-beb335beeeee with scrape type 1
2026-03-28 12:07:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3274a6e0-0b1a-5aba-a406-beb335beeeee sending to next pipeline
2026-03-28 12:07:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3274a6e0-0b1a-5aba-a406-beb335beeeee, identifier: KV81214
2026-03-28 12:07:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfaef10>
2026-03-28 12:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b60628-4f3c-5d4a-a89d-a2a00f9c5318/f6b60628-4f3c-5d4a-a89d-a2a00f9c5318_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F23%252Fae236281bbf1f5649f30d3cbb1017f93%252Fpa%252FRX99129_793ac037ae8f610a8c2d445df8cb1ac5.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_793ac037ae8f610a8c2d445df8cb1ac5.jpg saved to cache
2026-03-28 12:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f6b60628-4f3c-5d4a-a89d-a2a00f9c5318
2026-03-28 12:07:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f6b60628-4f3c-5d4a-a89d-a2a00f9c5318, skipping ID generation
2026-03-28 12:07:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6b60628-4f3c-5d4a-a89d-a2a00f9c5318 with scrape type 1
2026-03-28 12:07:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f6b60628-4f3c-5d4a-a89d-a2a00f9c5318 sending to next pipeline
2026-03-28 12:07:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f6b60628-4f3c-5d4a-a89d-a2a00f9c5318, identifier: RX99129
2026-03-28 12:07:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc6025d0>
2026-03-28 12:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fd24d2e-c7a4-5e24-94aa-abb81314b2a2/7fd24d2e-c7a4-5e24-94aa-abb81314b2a2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F4d%252F5c4dda21beac1477e02dd63c090b78c9%252Fpa%252FVU78996_f302ab680e79024021c22b6813f8bbe7.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_f302ab680e79024021c22b6813f8bbe7.jpg saved to cache
2026-03-28 12:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7fd24d2e-c7a4-5e24-94aa-abb81314b2a2
2026-03-28 12:07:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7fd24d2e-c7a4-5e24-94aa-abb81314b2a2, skipping ID generation
2026-03-28 12:07:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fd24d2e-c7a4-5e24-94aa-abb81314b2a2 with scrape type 1
2026-03-28 12:07:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7fd24d2e-c7a4-5e24-94aa-abb81314b2a2 sending to next pipeline
2026-03-28 12:07:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7fd24d2e-c7a4-5e24-94aa-abb81314b2a2, identifier: VU78996
2026-03-28 12:07:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 226ea16f-8e4c-5c8c-8029-e732542d307f with identifier: PR73005
2026-03-28 12:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 226ea16f-8e4c-5c8c-8029-e732542d307f with identifier: PR73005
2026-03-28 12:07:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 226ea16f-8e4c-5c8c-8029-e732542d307f with identifier: PR73005 to the API
2026-03-28 12:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_d9b3036d020384cba6103b3dbfddda97.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 42,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.3L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:15:13Z',
 'fuel_type': 'hybrid',
 'id': '226ea16f-8e4c-5c8c-8029-e732542d307f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR73005',
 'listing': 'auction',
 'location': 'IT, Casoria',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 25721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_226ea16f-8e4c-5c8c-8029-e732542d307f/226ea16f-8e4c-5c8c-8029-e732542d307f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70359,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_719ddd68f497b64d8b212daa0e8b67b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_226ea16f-8e4c-5c8c-8029-e732542d307f/226ea16f-8e4c-5c8c-8029-e732542d307f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2394346,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_d9b3036d020384cba6103b3dbfddda97.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_226ea16f-8e4c-5c8c-8029-e732542d307f/226ea16f-8e4c-5c8c-8029-e732542d307f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2364078,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_890db421af44164579b4b3a37cafd743.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_226ea16f-8e4c-5c8c-8029-e732542d307f/226ea16f-8e4c-5c8c-8029-e732542d307f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_d33315daa1e0364eca77cb5f3218c2cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_226ea16f-8e4c-5c8c-8029-e732542d307f/226ea16f-8e4c-5c8c-8029-e732542d307f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2383330,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_00c451b6d3564b601b6ace810cd3d0e4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_226ea16f-8e4c-5c8c-8029-e732542d307f/226ea16f-8e4c-5c8c-8029-e732542d307f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_8b6ff080d5295c06d3e931d4aadd280d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_226ea16f-8e4c-5c8c-8029-e732542d307f/226ea16f-8e4c-5c8c-8029-e732542d307f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40367,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_2b0e97886732499b7ce4088c82a0e5e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_226ea16f-8e4c-5c8c-8029-e732542d307f/226ea16f-8e4c-5c8c-8029-e732542d307f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_61c1b42fe8a7ce81d5c56b22f7b9e0ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_226ea16f-8e4c-5c8c-8029-e732542d307f/226ea16f-8e4c-5c8c-8029-e732542d307f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2506659,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_a1f20cb3f14562e0d9858db7c7712696.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_226ea16f-8e4c-5c8c-8029-e732542d307f/226ea16f-8e4c-5c8c-8029-e732542d307f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2605840,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/38/40380e14f263dd4a58844d0c434613aa/pa/PR73005_6a6ebbe996f1c609ad122ad09b1ab209.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Renegade 1.3 T4 4xe Plug-in Hybrid 80th Anniversary',
 'transmission': 'automatic',
 'trim': '80th Anniversary',
 'year': 2022}
2026-03-28 12:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR73005%27 HTTP/1.1" 200 None
2026-03-28 12:07:17 [auto1.it] INFO: Saving data for PR73005: {'created_time': 1774699637.399187, 'last_price_update_time': 1774699637.399198, 'auction_closing_time': 1774883713.0}
2026-03-28 12:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PR73005') HTTP/1.1" 204 0
2026-03-28 12:07:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3274a6e0-0b1a-5aba-a406-beb335beeeee with identifier: KV81214
2026-03-28 12:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3274a6e0-0b1a-5aba-a406-beb335beeeee with identifier: KV81214
2026-03-28 12:07:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3274a6e0-0b1a-5aba-a406-beb335beeeee with identifier: KV81214 to the API
2026-03-28 12:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_c3e01b59336097fe595549c330463a56.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:53:59Z',
 'fuel_type': 'diesel',
 'id': '3274a6e0-0b1a-5aba-a406-beb335beeeee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV81214',
 'listing': 'auction',
 'location': 'IT, Creazzo VI',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 174160,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3274a6e0-0b1a-5aba-a406-beb335beeeee/3274a6e0-0b1a-5aba-a406-beb335beeeee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2426839,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_c3e01b59336097fe595549c330463a56.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3274a6e0-0b1a-5aba-a406-beb335beeeee/3274a6e0-0b1a-5aba-a406-beb335beeeee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_6cd44bb293469f5a6d4a30626333ba1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3274a6e0-0b1a-5aba-a406-beb335beeeee/3274a6e0-0b1a-5aba-a406-beb335beeeee_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_c4546f9a0f561506b6a6c5b4f978f798.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3274a6e0-0b1a-5aba-a406-beb335beeeee/3274a6e0-0b1a-5aba-a406-beb335beeeee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2261902,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_454bd6223551c6e3da153266c3be9842.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3274a6e0-0b1a-5aba-a406-beb335beeeee/3274a6e0-0b1a-5aba-a406-beb335beeeee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_1d3254cf69cf95a1dce478b20f706fd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3274a6e0-0b1a-5aba-a406-beb335beeeee/3274a6e0-0b1a-5aba-a406-beb335beeeee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65824,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_31b1431ffb8a862102a7eb5a83f09bf7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3274a6e0-0b1a-5aba-a406-beb335beeeee/3274a6e0-0b1a-5aba-a406-beb335beeeee_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_d80e9d2f13ee6986aa90e5c9b3aad1d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3274a6e0-0b1a-5aba-a406-beb335beeeee/3274a6e0-0b1a-5aba-a406-beb335beeeee_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_cc019a1033e68571809600675ea4bef4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3274a6e0-0b1a-5aba-a406-beb335beeeee/3274a6e0-0b1a-5aba-a406-beb335beeeee_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2333006,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_13b61f9190063883faf5719181c051cc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3274a6e0-0b1a-5aba-a406-beb335beeeee/3274a6e0-0b1a-5aba-a406-beb335beeeee_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64157,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/6c/b06c97d8b1deae9be098e8feb68c95cf/pa/KV81214_ca954c71bcacaa94e45f77f11898a61a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-11-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-28 12:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KV81214%27 HTTP/1.1" 200 None
2026-03-28 12:07:17 [auto1.it] INFO: Saving data for KV81214: {'created_time': 1774699637.910229, 'last_price_update_time': 1774699637.91024, 'auction_closing_time': 1774886039.0}
2026-03-28 12:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KV81214') HTTP/1.1" 204 0
2026-03-28 12:07:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f6b60628-4f3c-5d4a-a89d-a2a00f9c5318 with identifier: RX99129
2026-03-28 12:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f6b60628-4f3c-5d4a-a89d-a2a00f9c5318 with identifier: RX99129
2026-03-28 12:07:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f6b60628-4f3c-5d4a-a89d-a2a00f9c5318 with identifier: RX99129 to the API
2026-03-28 12:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_793ac037ae8f610a8c2d445df8cb1ac5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 161,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:33:26Z',
 'fuel_type': 'diesel',
 'id': 'f6b60628-4f3c-5d4a-a89d-a2a00f9c5318',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX99129',
 'listing': 'auction',
 'location': 'IT, Palermo',
 'make': 'Ford',
 'model': 'Transit Connect',
 'odometer': 49913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b60628-4f3c-5d4a-a89d-a2a00f9c5318/f6b60628-4f3c-5d4a-a89d-a2a00f9c5318_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92132,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_25fbb9f15fd91d3bf81ac8cbca124219.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b60628-4f3c-5d4a-a89d-a2a00f9c5318/f6b60628-4f3c-5d4a-a89d-a2a00f9c5318_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_2bf4786707e54a43ef6c4b6b9ac00328.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b60628-4f3c-5d4a-a89d-a2a00f9c5318/f6b60628-4f3c-5d4a-a89d-a2a00f9c5318_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2933277,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_ac11ca91085f12aa5d3b3c6a46fafbaa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b60628-4f3c-5d4a-a89d-a2a00f9c5318/f6b60628-4f3c-5d4a-a89d-a2a00f9c5318_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2857605,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_5dbd09f70bbef93ea5c6e08197ab2cb1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b60628-4f3c-5d4a-a89d-a2a00f9c5318/f6b60628-4f3c-5d4a-a89d-a2a00f9c5318_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2954564,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_429aee183698da864cc54d72ef7c498a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b60628-4f3c-5d4a-a89d-a2a00f9c5318/f6b60628-4f3c-5d4a-a89d-a2a00f9c5318_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3090254,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_d778b0507335f41225fc2648063091db.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b60628-4f3c-5d4a-a89d-a2a00f9c5318/f6b60628-4f3c-5d4a-a89d-a2a00f9c5318_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_84b8fd46012273fd36f29325fcf6f6ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b60628-4f3c-5d4a-a89d-a2a00f9c5318/f6b60628-4f3c-5d4a-a89d-a2a00f9c5318_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_68fcfa2335b45742272e2e2b334e805f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b60628-4f3c-5d4a-a89d-a2a00f9c5318/f6b60628-4f3c-5d4a-a89d-a2a00f9c5318_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_62cefddd0b15f26c2ec5720ff3c3a195.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b60628-4f3c-5d4a-a89d-a2a00f9c5318/f6b60628-4f3c-5d4a-a89d-a2a00f9c5318_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2881788,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/23/ae236281bbf1f5649f30d3cbb1017f93/pa/RX99129_793ac037ae8f610a8c2d445df8cb1ac5.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-10-22',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit Connect 1.5 EcoBlue TDCi Kasten Trend lang',
 'transmission': 'automatic',
 'trim': 'Kasten Trend lang',
 'year': 2023}
2026-03-28 12:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX99129%27 HTTP/1.1" 200 None
2026-03-28 12:07:18 [auto1.it] INFO: Saving data for RX99129: {'created_time': 1774699638.279271, 'last_price_update_time': 1774699638.279281, 'auction_closing_time': 1774884806.0}
2026-03-28 12:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RX99129') HTTP/1.1" 204 0
2026-03-28 12:07:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7fd24d2e-c7a4-5e24-94aa-abb81314b2a2 with identifier: VU78996
2026-03-28 12:07:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7fd24d2e-c7a4-5e24-94aa-abb81314b2a2 with identifier: VU78996
2026-03-28 12:07:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7fd24d2e-c7a4-5e24-94aa-abb81314b2a2 with identifier: VU78996 to the API
2026-03-28 12:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_f302ab680e79024021c22b6813f8bbe7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:30:25Z',
 'fuel_type': 'diesel',
 'id': '7fd24d2e-c7a4-5e24-94aa-abb81314b2a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU78996',
 'listing': 'auction',
 'location': 'IT, Roma RM',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 87626,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd24d2e-c7a4-5e24-94aa-abb81314b2a2/7fd24d2e-c7a4-5e24-94aa-abb81314b2a2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2601901,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_f302ab680e79024021c22b6813f8bbe7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd24d2e-c7a4-5e24-94aa-abb81314b2a2/7fd24d2e-c7a4-5e24-94aa-abb81314b2a2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_ce57f0e60e03b996bd8372dab1bbb9da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd24d2e-c7a4-5e24-94aa-abb81314b2a2/7fd24d2e-c7a4-5e24-94aa-abb81314b2a2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_e273b381e53d46ff9c1ab26632080c1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd24d2e-c7a4-5e24-94aa-abb81314b2a2/7fd24d2e-c7a4-5e24-94aa-abb81314b2a2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2477354,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_58f294f5f00d7fb77e6f470df98a500c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd24d2e-c7a4-5e24-94aa-abb81314b2a2/7fd24d2e-c7a4-5e24-94aa-abb81314b2a2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_6d2c960c88e7b008e34ec61e3ba78c2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd24d2e-c7a4-5e24-94aa-abb81314b2a2/7fd24d2e-c7a4-5e24-94aa-abb81314b2a2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_a40f63d240efad16b1bc89d1286e3973.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd24d2e-c7a4-5e24-94aa-abb81314b2a2/7fd24d2e-c7a4-5e24-94aa-abb81314b2a2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_2437d584f6843094b7db146ffc3c188c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd24d2e-c7a4-5e24-94aa-abb81314b2a2/7fd24d2e-c7a4-5e24-94aa-abb81314b2a2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2750211,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_300d63709fb34ebc1c929aecf3ee6b4e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd24d2e-c7a4-5e24-94aa-abb81314b2a2/7fd24d2e-c7a4-5e24-94aa-abb81314b2a2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2714903,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_55c490e4d646390b31c58a5c93486ba6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd24d2e-c7a4-5e24-94aa-abb81314b2a2/7fd24d2e-c7a4-5e24-94aa-abb81314b2a2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/4d/5c4dda21beac1477e02dd63c090b78c9/pa/VU78996_623a7fcde1de497936ddd0839bb3a99a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford C-Max 1.6 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2014}
2026-03-28 12:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU78996%27 HTTP/1.1" 200 None
2026-03-28 12:07:18 [auto1.it] INFO: Saving data for VU78996: {'created_time': 1774699638.645932, 'last_price_update_time': 1774699638.645942, 'auction_closing_time': 1774884625.0}
2026-03-28 12:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VU78996') HTTP/1.1" 204 0
2026-03-28 12:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_af7feaf571dfd46f4597362eb02293df.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_0f7203bf7ca9d7efee9d4ee5ae33baba.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FN08703> (referer: https://www.auto1.com/v1/car-details-view/FN08703/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PR01158/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LW42205/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PX02634/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZU99068> (referer: https://www.auto1.com/v1/car-details-view/ZU99068/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WE07120> (referer: https://www.auto1.com/v1/car-details-view/WE07120/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcea4dd0>
2026-03-28 12:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d847a549-bef9-5b48-b0af-ad4a5c54f2d2/d847a549-bef9-5b48-b0af-ad4a5c54f2d2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F49%252Ff649cae8d0e344c8b0fdfe07053833a3%252Fpa%252FRC42052_cecad94d2baf64cc5233136646ead31b.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_cecad94d2baf64cc5233136646ead31b.jpg saved to cache
2026-03-28 12:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d847a549-bef9-5b48-b0af-ad4a5c54f2d2
2026-03-28 12:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_da657a216fca8dd2d446364d6ae99d7b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_32ae141e0b6454242b5bc4a6753a57d5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc54f390>
2026-03-28 12:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b7d8151-7119-57f9-be13-cd5ecb373c85/1b7d8151-7119-57f9-be13-cd5ecb373c85_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fc8%252F1ac8376a89c10f343dcbcf68449f935a%252Fpa%252FUN20093_af7feaf571dfd46f4597362eb02293df.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_af7feaf571dfd46f4597362eb02293df.jpg saved to cache
2026-03-28 12:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1b7d8151-7119-57f9-be13-cd5ecb373c85
2026-03-28 12:07:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b7d8151-7119-57f9-be13-cd5ecb373c85, skipping ID generation
2026-03-28 12:07:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b7d8151-7119-57f9-be13-cd5ecb373c85 with scrape type 1
2026-03-28 12:07:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1b7d8151-7119-57f9-be13-cd5ecb373c85 sending to next pipeline
2026-03-28 12:07:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1b7d8151-7119-57f9-be13-cd5ecb373c85, identifier: UN20093
2026-03-28 12:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd0f38d0>
2026-03-28 12:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1540861-55d8-5622-83cc-65661a4f82a9/f1540861-55d8-5622-83cc-65661a4f82a9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ffa%252Fb0fa5fe76c0edb84d6f2dd581689e2ef%252Fpa%252FFR55532_0f7203bf7ca9d7efee9d4ee5ae33baba.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_0f7203bf7ca9d7efee9d4ee5ae33baba.jpg saved to cache
2026-03-28 12:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f1540861-55d8-5622-83cc-65661a4f82a9
2026-03-28 12:07:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1b7d8151-7119-57f9-be13-cd5ecb373c85 with identifier: UN20093
2026-03-28 12:07:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1b7d8151-7119-57f9-be13-cd5ecb373c85 with identifier: UN20093
2026-03-28 12:07:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1b7d8151-7119-57f9-be13-cd5ecb373c85 with identifier: UN20093 to the API
2026-03-28 12:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_af7feaf571dfd46f4597362eb02293df.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:22:28Z',
 'fuel_type': 'diesel',
 'id': '1b7d8151-7119-57f9-be13-cd5ecb373c85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN20093',
 'listing': 'auction',
 'location': 'IT, Arezzo',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 231959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b7d8151-7119-57f9-be13-cd5ecb373c85/1b7d8151-7119-57f9-be13-cd5ecb373c85_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_e85fbb366a8e6ddf8a7cfbd731211bba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b7d8151-7119-57f9-be13-cd5ecb373c85/1b7d8151-7119-57f9-be13-cd5ecb373c85_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_a1807ccc40998d899a08ca143b216955.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b7d8151-7119-57f9-be13-cd5ecb373c85/1b7d8151-7119-57f9-be13-cd5ecb373c85_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_8ac82532bfcd070d1b35bc8a1d295394.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b7d8151-7119-57f9-be13-cd5ecb373c85/1b7d8151-7119-57f9-be13-cd5ecb373c85_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_885e75c9f66a9559daa8866001a53ba9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b7d8151-7119-57f9-be13-cd5ecb373c85/1b7d8151-7119-57f9-be13-cd5ecb373c85_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2309765,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_62006c306f6c60bbfabad49d002d4286.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b7d8151-7119-57f9-be13-cd5ecb373c85/1b7d8151-7119-57f9-be13-cd5ecb373c85_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_2ac729a3a32612a135d1f573656cb682.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b7d8151-7119-57f9-be13-cd5ecb373c85/1b7d8151-7119-57f9-be13-cd5ecb373c85_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2254295,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_cba61a1dfcffac6746a56c5c2935cb6f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b7d8151-7119-57f9-be13-cd5ecb373c85/1b7d8151-7119-57f9-be13-cd5ecb373c85_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70415,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_af7feaf571dfd46f4597362eb02293df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b7d8151-7119-57f9-be13-cd5ecb373c85/1b7d8151-7119-57f9-be13-cd5ecb373c85_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66235,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_95f17ff18251f808989bf5657d8cf257.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b7d8151-7119-57f9-be13-cd5ecb373c85/1b7d8151-7119-57f9-be13-cd5ecb373c85_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/c8/1ac8376a89c10f343dcbcf68449f935a/pa/UN20093_a0ea3ca0fbc798fe71c60624414ff3de.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Business BlueMotion',
 'transmission': 'manual',
 'trim': 'Business BlueMotion',
 'year': 2018}
2026-03-28 12:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN20093%27 HTTP/1.1" 200 None
2026-03-28 12:07:19 [auto1.it] INFO: Saving data for UN20093: {'created_time': 1774699639.378236, 'last_price_update_time': 1774699639.378248, 'auction_closing_time': 1774884148.0}
2026-03-28 12:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UN20093') HTTP/1.1" 204 0
2026-03-28 12:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_ef052084c24b047fadbb560fcb3d915f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebd64a4d-f1d7-5b81-9670-d82009ea60d4 with identifier: FN08703
2026-03-28 12:07:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebd64a4d-f1d7-5b81-9670-d82009ea60d4 with scrape type 1
2026-03-28 12:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item ebd64a4d-f1d7-5b81-9670-d82009ea60d4
2026-03-28 12:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fc9%252F8fc9ee60c102b393c710b4d88be2bc39%252Fpa%252FFN08703_f1781ae931fd6286a06aee2be8c111dd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/c9/8fc9ee60c102b393c710b4d88be2bc39/pa/FN08703_f1781ae931fd6286a06aee2be8c111dd.jpg not downloaded yet
2026-03-28 12:07:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f763ea7-ce15-5ece-896e-a594d3541815 with identifier: ZU99068
2026-03-28 12:07:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f763ea7-ce15-5ece-896e-a594d3541815 with scrape type 1
2026-03-28 12:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4f763ea7-ce15-5ece-896e-a594d3541815
2026-03-28 12:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F6d%252F886da012a44baf6c7335c7f089633526%252Fpa%252FZU99068_9bf30398840c43074a9360b8a2b2bc72.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/6d/886da012a44baf6c7335c7f089633526/pa/ZU99068_9bf30398840c43074a9360b8a2b2bc72.jpg already downloaded
2026-03-28 12:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F6d%252F886da012a44baf6c7335c7f089633526%252Fpa%252FZU99068_762137f552d872ff8ef20b64db81d250.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/6d/886da012a44baf6c7335c7f089633526/pa/ZU99068_762137f552d872ff8ef20b64db81d250.jpg already downloaded
2026-03-28 12:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F6d%252F886da012a44baf6c7335c7f089633526%252Fpa%252FZU99068_77bf38ebcd4a0b15a8b8b1850281f93b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/6d/886da012a44baf6c7335c7f089633526/pa/ZU99068_77bf38ebcd4a0b15a8b8b1850281f93b.jpg already downloaded
2026-03-28 12:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F6d%252F886da012a44baf6c7335c7f089633526%252Fpa%252FZU99068_ea12b4454326ac8565ae16bc264d29af.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/6d/886da012a44baf6c7335c7f089633526/pa/ZU99068_ea12b4454326ac8565ae16bc264d29af.jpg already downloaded
2026-03-28 12:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F6d%252F886da012a44baf6c7335c7f089633526%252Fpa%252FZU99068_8a6d1b581bef0789f05cdc8379291307.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/6d/886da012a44baf6c7335c7f089633526/pa/ZU99068_8a6d1b581bef0789f05cdc8379291307.jpg already downloaded
2026-03-28 12:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F6d%252F886da012a44baf6c7335c7f089633526%252Fpa%252FZU99068_1d2d04c49fee9a944d5bdf844afacaf6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/6d/886da012a44baf6c7335c7f089633526/pa/ZU99068_1d2d04c49fee9a944d5bdf844afacaf6.jpg already downloaded
2026-03-28 12:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F6d%252F886da012a44baf6c7335c7f089633526%252Fpa%252FZU99068_0b10e2a9678c11733a3cb76e608eb4b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/6d/886da012a44baf6c7335c7f089633526/pa/ZU99068_0b10e2a9678c11733a3cb76e608eb4b3.jpg already downloaded
2026-03-28 12:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F6d%252F886da012a44baf6c7335c7f089633526%252Fpa%252FZU99068_b4b634f8a136524aa5411a14f80154ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/6d/886da012a44baf6c7335c7f089633526/pa/ZU99068_b4b634f8a136524aa5411a14f80154ae.jpg already downloaded
2026-03-28 12:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F6d%252F886da012a44baf6c7335c7f089633526%252Fpa%252FZU99068_a8f8f984ea328f9e34306a4cad762ff4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/6d/886da012a44baf6c7335c7f089633526/pa/ZU99068_a8f8f984ea328f9e34306a4cad762ff4.jpg already downloaded
2026-03-28 12:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F6d%252F886da012a44baf6c7335c7f089633526%252Fpa%252FZU99068_6d1ffc1c15337c913c08b74bde12b056.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/6d/886da012a44baf6c7335c7f089633526/pa/ZU99068_6d1ffc1c15337c913c08b74bde12b056.jpg already downloaded
2026-03-28 12:07:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4f763ea7-ce15-5ece-896e-a594d3541815, identifier: ZU99068
2026-03-28 12:07:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f00bd372-daee-5485-9760-fa7b77557807 with identifier: WE07120
2026-03-28 12:07:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f00bd372-daee-5485-9760-fa7b77557807 with scrape type 1
2026-03-28 12:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f00bd372-daee-5485-9760-fa7b77557807
2026-03-28 12:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fb2%252Ffbb21e5b327e725908bfb692f2353587%252Fpa%252FWE07120_4ebf409cbce89a3d30424c8127db790d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_4ebf409cbce89a3d30424c8127db790d.jpg not downloaded yet
2026-03-28 12:07:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3a43d0>
2026-03-28 12:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1540861-55d8-5622-83cc-65661a4f82a9/f1540861-55d8-5622-83cc-65661a4f82a9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ffa%252Fb0fa5fe76c0edb84d6f2dd581689e2ef%252Fpa%252FFR55532_da657a216fca8dd2d446364d6ae99d7b.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_da657a216fca8dd2d446364d6ae99d7b.jpg saved to cache
2026-03-28 12:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f1540861-55d8-5622-83cc-65661a4f82a9
2026-03-28 12:07:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f1540861-55d8-5622-83cc-65661a4f82a9, skipping ID generation
2026-03-28 12:07:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1540861-55d8-5622-83cc-65661a4f82a9 with scrape type 1
2026-03-28 12:07:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f1540861-55d8-5622-83cc-65661a4f82a9 sending to next pipeline
2026-03-28 12:07:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f1540861-55d8-5622-83cc-65661a4f82a9, identifier: FR55532
2026-03-28 12:07:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc2d8b50>
2026-03-28 12:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d847a549-bef9-5b48-b0af-ad4a5c54f2d2/d847a549-bef9-5b48-b0af-ad4a5c54f2d2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F49%252Ff649cae8d0e344c8b0fdfe07053833a3%252Fpa%252FRC42052_32ae141e0b6454242b5bc4a6753a57d5.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_32ae141e0b6454242b5bc4a6753a57d5.jpg saved to cache
2026-03-28 12:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d847a549-bef9-5b48-b0af-ad4a5c54f2d2
2026-03-28 12:07:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4f763ea7-ce15-5ece-896e-a594d3541815 with identifier: ZU99068
2026-03-28 12:07:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4f763ea7-ce15-5ece-896e-a594d3541815 with identifier: ZU99068
2026-03-28 12:07:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4f763ea7-ce15-5ece-896e-a594d3541815 with identifier: ZU99068 to the API
2026-03-28 12:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZU99068>
{'auction_title': '',
 'c_o_2_emission_value': 229,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.5L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:35:05Z',
 'fuel_type': 'petrol',
 'id': '4f763ea7-ce15-5ece-896e-a594d3541815',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU99068',
 'listing': 'auction',
 'location': 'IT, DECIMOMANNU (CA)',
 'make': 'Jaguar',
 'model': 'S-TYPE',
 'odometer': 57911,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img88/6d/886da012a44baf6c7335c7f089633526/pa/ZU99068_9bf30398840c43074a9360b8a2b2bc72.jpg',
                'https://img-pa.auto1.com/img88/6d/886da012a44baf6c7335c7f089633526/pa/ZU99068_762137f552d872ff8ef20b64db81d250.jpg',
                'https://img-pa.auto1.com/img88/6d/886da012a44baf6c7335c7f089633526/pa/ZU99068_77bf38ebcd4a0b15a8b8b1850281f93b.jpg',
                'https://img-pa.auto1.com/img88/6d/886da012a44baf6c7335c7f089633526/pa/ZU99068_ea12b4454326ac8565ae16bc264d29af.jpg',
                'https://img-pa.auto1.com/img88/6d/886da012a44baf6c7335c7f089633526/pa/ZU99068_8a6d1b581bef0789f05cdc8379291307.jpg',
                'https://img-pa.auto1.com/img88/6d/886da012a44baf6c7335c7f089633526/pa/ZU99068_1d2d04c49fee9a944d5bdf844afacaf6.jpg',
                'https://img-pa.auto1.com/img88/6d/886da012a44baf6c7335c7f089633526/pa/ZU99068_0b10e2a9678c11733a3cb76e608eb4b3.jpg',
                'https://img-pa.auto1.com/img88/6d/886da012a44baf6c7335c7f089633526/pa/ZU99068_b4b634f8a136524aa5411a14f80154ae.jpg',
                'https://img-pa.auto1.com/img88/6d/886da012a44baf6c7335c7f089633526/pa/ZU99068_a8f8f984ea328f9e34306a4cad762ff4.jpg',
                'https://img-pa.auto1.com/img88/6d/886da012a44baf6c7335c7f089633526/pa/ZU99068_6d1ffc1c15337c913c08b74bde12b056.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f763ea7-ce15-5ece-896e-a594d3541815/4f763ea7-ce15-5ece-896e-a594d3541815_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315525,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img88/6d/886da012a44baf6c7335c7f089633526/pa/ZU99068_9bf30398840c43074a9360b8a2b2bc72.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f763ea7-ce15-5ece-896e-a594d3541815/4f763ea7-ce15-5ece-896e-a594d3541815_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316314,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img88/6d/886da012a44baf6c7335c7f089633526/pa/ZU99068_762137f552d872ff8ef20b64db81d250.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f763ea7-ce15-5ece-896e-a594d3541815/4f763ea7-ce15-5ece-896e-a594d3541815_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277222,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img88/6d/886da012a44baf6c7335c7f089633526/pa/ZU99068_77bf38ebcd4a0b15a8b8b1850281f93b.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f763ea7-ce15-5ece-896e-a594d3541815/4f763ea7-ce15-5ece-896e-a594d3541815_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254956,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img88/6d/886da012a44baf6c7335c7f089633526/pa/ZU99068_ea12b4454326ac8565ae16bc264d29af.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f763ea7-ce15-5ece-896e-a594d3541815/4f763ea7-ce15-5ece-896e-a594d3541815_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/6d/886da012a44baf6c7335c7f089633526/pa/ZU99068_8a6d1b581bef0789f05cdc8379291307.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f763ea7-ce15-5ece-896e-a594d3541815/4f763ea7-ce15-5ece-896e-a594d3541815_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301707,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img88/6d/886da012a44baf6c7335c7f089633526/pa/ZU99068_1d2d04c49fee9a944d5bdf844afacaf6.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f763ea7-ce15-5ece-896e-a594d3541815/4f763ea7-ce15-5ece-896e-a594d3541815_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265895,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img88/6d/886da012a44baf6c7335c7f089633526/pa/ZU99068_0b10e2a9678c11733a3cb76e608eb4b3.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f763ea7-ce15-5ece-896e-a594d3541815/4f763ea7-ce15-5ece-896e-a594d3541815_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288952,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img88/6d/886da012a44baf6c7335c7f089633526/pa/ZU99068_b4b634f8a136524aa5411a14f80154ae.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f763ea7-ce15-5ece-896e-a594d3541815/4f763ea7-ce15-5ece-896e-a594d3541815_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275883,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img88/6d/886da012a44baf6c7335c7f089633526/pa/ZU99068_a8f8f984ea328f9e34306a4cad762ff4.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f763ea7-ce15-5ece-896e-a594d3541815/4f763ea7-ce15-5ece-896e-a594d3541815_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217865,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img88/6d/886da012a44baf6c7335c7f089633526/pa/ZU99068_6d1ffc1c15337c913c08b74bde12b056.jpg',
             'Width': 1200}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-01-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar S-TYPE 2.5 V6 Executive',
 'transmission': 'manual',
 'trim': 'Executive',
 'year': 2003}
2026-03-28 12:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU99068%27 HTTP/1.1" 200 None
2026-03-28 12:07:20 [auto1.it] INFO: Saving data for ZU99068: {'created_time': 1774699640.587364, 'last_price_update_time': 1774699640.587374, 'auction_closing_time': 1774884905.0}
2026-03-28 12:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZU99068') HTTP/1.1" 204 0
2026-03-28 12:07:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f1540861-55d8-5622-83cc-65661a4f82a9 with identifier: FR55532
2026-03-28 12:07:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f1540861-55d8-5622-83cc-65661a4f82a9 with identifier: FR55532
2026-03-28 12:07:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f1540861-55d8-5622-83cc-65661a4f82a9 with identifier: FR55532 to the API
2026-03-28 12:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_da657a216fca8dd2d446364d6ae99d7b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:18:13Z',
 'fuel_type': 'petrol',
 'id': 'f1540861-55d8-5622-83cc-65661a4f82a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR55532',
 'listing': 'auction',
 'location': 'IT, Genova',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 83364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1540861-55d8-5622-83cc-65661a4f82a9/f1540861-55d8-5622-83cc-65661a4f82a9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2539158,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_e41cc6d207d7f4045ca21fc0c5075312.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1540861-55d8-5622-83cc-65661a4f82a9/f1540861-55d8-5622-83cc-65661a4f82a9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2457721,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_da657a216fca8dd2d446364d6ae99d7b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1540861-55d8-5622-83cc-65661a4f82a9/f1540861-55d8-5622-83cc-65661a4f82a9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_0f7203bf7ca9d7efee9d4ee5ae33baba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1540861-55d8-5622-83cc-65661a4f82a9/f1540861-55d8-5622-83cc-65661a4f82a9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_c71be92bb040e08ef01ae7aeaa494af3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1540861-55d8-5622-83cc-65661a4f82a9/f1540861-55d8-5622-83cc-65661a4f82a9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_d556588c082306a67afde73ae277543f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1540861-55d8-5622-83cc-65661a4f82a9/f1540861-55d8-5622-83cc-65661a4f82a9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_a02ecd1c9a5f422d9ca298e925d969bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1540861-55d8-5622-83cc-65661a4f82a9/f1540861-55d8-5622-83cc-65661a4f82a9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55121,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_e3fad41716fb4922e3b7479ab0743010.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1540861-55d8-5622-83cc-65661a4f82a9/f1540861-55d8-5622-83cc-65661a4f82a9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_28a33722975842514a2fea117fb6139f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1540861-55d8-5622-83cc-65661a4f82a9/f1540861-55d8-5622-83cc-65661a4f82a9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_8aab7c86657340a03585380cdabf4233.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1540861-55d8-5622-83cc-65661a4f82a9/f1540861-55d8-5622-83cc-65661a4f82a9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/fa/b0fa5fe76c0edb84d6f2dd581689e2ef/pa/FR55532_809bd45ab1337a18fb187785b928d366.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2018}
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR55532%27 HTTP/1.1" 200 None
2026-03-28 12:07:21 [auto1.it] INFO: Saving data for FR55532: {'created_time': 1774699641.021735, 'last_price_update_time': 1774699641.021744, 'auction_closing_time': 1774883893.0}
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FR55532') HTTP/1.1" 204 0
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fc9%252F8fc9ee60c102b393c710b4d88be2bc39%252Fpa%252FFN08703_68ee134a18c21fcd1c2c658a038df410.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/c9/8fc9ee60c102b393c710b4d88be2bc39/pa/FN08703_68ee134a18c21fcd1c2c658a038df410.jpg not downloaded yet
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fb2%252Ffbb21e5b327e725908bfb692f2353587%252Fpa%252FWE07120_178df8cb237eb312e8dc24207d742f9c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_178df8cb237eb312e8dc24207d742f9c.jpg not downloaded yet
2026-03-28 12:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fc9%252F8fc9ee60c102b393c710b4d88be2bc39%252Fpa%252FFN08703_f9d64a363383c3871119692cd4f3215f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/c9/8fc9ee60c102b393c710b4d88be2bc39/pa/FN08703_f9d64a363383c3871119692cd4f3215f.jpg not downloaded yet
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fb2%252Ffbb21e5b327e725908bfb692f2353587%252Fpa%252FWE07120_8d0ff902bc4cd50ea644d78138dee31c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_8d0ff902bc4cd50ea644d78138dee31c.jpg not downloaded yet
2026-03-28 12:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc58d150>
2026-03-28 12:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d847a549-bef9-5b48-b0af-ad4a5c54f2d2/d847a549-bef9-5b48-b0af-ad4a5c54f2d2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F49%252Ff649cae8d0e344c8b0fdfe07053833a3%252Fpa%252FRC42052_ef052084c24b047fadbb560fcb3d915f.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_ef052084c24b047fadbb560fcb3d915f.jpg saved to cache
2026-03-28 12:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d847a549-bef9-5b48-b0af-ad4a5c54f2d2
2026-03-28 12:07:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d847a549-bef9-5b48-b0af-ad4a5c54f2d2, skipping ID generation
2026-03-28 12:07:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d847a549-bef9-5b48-b0af-ad4a5c54f2d2 with scrape type 1
2026-03-28 12:07:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d847a549-bef9-5b48-b0af-ad4a5c54f2d2 sending to next pipeline
2026-03-28 12:07:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d847a549-bef9-5b48-b0af-ad4a5c54f2d2, identifier: RC42052
2026-03-28 12:07:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d847a549-bef9-5b48-b0af-ad4a5c54f2d2 with identifier: RC42052
2026-03-28 12:07:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d847a549-bef9-5b48-b0af-ad4a5c54f2d2 with identifier: RC42052
2026-03-28 12:07:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d847a549-bef9-5b48-b0af-ad4a5c54f2d2 with identifier: RC42052 to the API
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_ef052084c24b047fadbb560fcb3d915f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 227,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.5L',
 'engine_horse_power': 400,
 'expiration_date': '2026-03-30T15:31:44Z',
 'fuel_type': 'petrol',
 'id': 'd847a549-bef9-5b48-b0af-ad4a5c54f2d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC42052',
 'listing': 'auction',
 'location': 'IT, Frosinone',
 'make': 'Audi',
 'model': 'RS Q3 Sportback',
 'odometer': 102308,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d847a549-bef9-5b48-b0af-ad4a5c54f2d2/d847a549-bef9-5b48-b0af-ad4a5c54f2d2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_136f9006f7d8d483ebbe4985f52adf40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d847a549-bef9-5b48-b0af-ad4a5c54f2d2/d847a549-bef9-5b48-b0af-ad4a5c54f2d2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84771,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_ef052084c24b047fadbb560fcb3d915f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d847a549-bef9-5b48-b0af-ad4a5c54f2d2/d847a549-bef9-5b48-b0af-ad4a5c54f2d2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3093937,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_21429542c8c654d41bf5ffd49e33b880.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d847a549-bef9-5b48-b0af-ad4a5c54f2d2/d847a549-bef9-5b48-b0af-ad4a5c54f2d2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_b71cf290e69af22289d9e819b42d1d3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d847a549-bef9-5b48-b0af-ad4a5c54f2d2/d847a549-bef9-5b48-b0af-ad4a5c54f2d2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_b8639e974d723aaf28e2de7becef4c25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d847a549-bef9-5b48-b0af-ad4a5c54f2d2/d847a549-bef9-5b48-b0af-ad4a5c54f2d2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_ab184af7f3e5dcf18dd518f7da901c91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d847a549-bef9-5b48-b0af-ad4a5c54f2d2/d847a549-bef9-5b48-b0af-ad4a5c54f2d2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2632095,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_11df6cc8714bde5dbceec8d82e586d45.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d847a549-bef9-5b48-b0af-ad4a5c54f2d2/d847a549-bef9-5b48-b0af-ad4a5c54f2d2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2783587,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_32ae141e0b6454242b5bc4a6753a57d5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d847a549-bef9-5b48-b0af-ad4a5c54f2d2/d847a549-bef9-5b48-b0af-ad4a5c54f2d2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_cecad94d2baf64cc5233136646ead31b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d847a549-bef9-5b48-b0af-ad4a5c54f2d2/d847a549-bef9-5b48-b0af-ad4a5c54f2d2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/49/f649cae8d0e344c8b0fdfe07053833a3/pa/RC42052_4f188a4165e25794cb93aea152e0f819.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi RS Q3 Sportback 2.5 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2021}
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC42052%27 HTTP/1.1" 200 None
2026-03-28 12:07:21 [auto1.it] INFO: Saving data for RC42052: {'created_time': 1774699641.580747, 'last_price_update_time': 1774699641.580757, 'auction_closing_time': 1774884704.0}
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RC42052') HTTP/1.1" 204 0
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fc9%252F8fc9ee60c102b393c710b4d88be2bc39%252Fpa%252FFN08703_c6c302df11d4b4a76bb36a233b08f868.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/c9/8fc9ee60c102b393c710b4d88be2bc39/pa/FN08703_c6c302df11d4b4a76bb36a233b08f868.jpg not downloaded yet
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fb2%252Ffbb21e5b327e725908bfb692f2353587%252Fpa%252FWE07120_f1531522a73ef707d920bc495b3114b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_f1531522a73ef707d920bc495b3114b1.jpg not downloaded yet
2026-03-28 12:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CR10860/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:21 [auto1.it] INFO: Channel: 24h | Page: 11 | totalHits: 3674 | hits on page: 40
2026-03-28 12:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/c9/8fc9ee60c102b393c710b4d88be2bc39/pa/FN08703_f1781ae931fd6286a06aee2be8c111dd.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fc9%252F8fc9ee60c102b393c710b4d88be2bc39%252Fpa%252FFN08703_888904ad3231ff1c57b5ecd3d2fe1f67.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/c9/8fc9ee60c102b393c710b4d88be2bc39/pa/FN08703_888904ad3231ff1c57b5ecd3d2fe1f67.jpg not downloaded yet
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fb2%252Ffbb21e5b327e725908bfb692f2353587%252Fpa%252FWE07120_ea82b5b32a8b4e6030ac1e770608be59.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_ea82b5b32a8b4e6030ac1e770608be59.jpg not downloaded yet
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: PD66788
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD66788%27 HTTP/1.1" 200 None
2026-03-28 12:07:21 [auto1.it] INFO: Scrape type for PD66788: 0
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: EY62849
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY62849%27 HTTP/1.1" 200 None
2026-03-28 12:07:21 [auto1.it] INFO: Scrape type for EY62849: 0
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: LB25951
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB25951%27 HTTP/1.1" 200 None
2026-03-28 12:07:21 [auto1.it] INFO: Scrape type for LB25951: 0
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: MJ44765
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: TM47514
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TM47514%27 HTTP/1.1" 200 None
2026-03-28 12:07:21 [auto1.it] INFO: Scrape type for TM47514: 0
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: PB29949
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: CE18152
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: ER01593
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ER01593%27 HTTP/1.1" 200 None
2026-03-28 12:07:21 [auto1.it] INFO: Scrape type for ER01593: 0
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: PN94289
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: YY00281
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY00281%27 HTTP/1.1" 200 None
2026-03-28 12:07:21 [auto1.it] INFO: Scrape type for YY00281: 0
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: UR28230
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR28230%27 HTTP/1.1" 200 None
2026-03-28 12:07:21 [auto1.it] INFO: Scrape type for UR28230: 0
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: YE38738
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YE38738%27 HTTP/1.1" 200 None
2026-03-28 12:07:21 [auto1.it] INFO: Scrape type for YE38738: 0
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: AT20318
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: RG08819
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: KZ05620
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: FC17087
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: CD48597
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD48597%27 HTTP/1.1" 200 None
2026-03-28 12:07:21 [auto1.it] INFO: Scrape type for CD48597: 0
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: ML74945
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: SD37804
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: LR48777
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: GU75904
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: WK43313
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK43313%27 HTTP/1.1" 200 None
2026-03-28 12:07:21 [auto1.it] INFO: Scrape type for WK43313: 0
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: BK04078
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BK04078%27 HTTP/1.1" 200 None
2026-03-28 12:07:21 [auto1.it] INFO: Scrape type for BK04078: 0
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: XY04064
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY04064%27 HTTP/1.1" 200 None
2026-03-28 12:07:21 [auto1.it] INFO: Scrape type for XY04064: 0
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: ML03059
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: CX68845
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: XY56734
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: RG91775
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: MV49803
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: SL86512
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SL86512%27 HTTP/1.1" 200 None
2026-03-28 12:07:21 [auto1.it] INFO: Scrape type for SL86512: 0
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: EE91281
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE91281%27 HTTP/1.1" 200 None
2026-03-28 12:07:21 [auto1.it] INFO: Scrape type for EE91281: 0
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: DC62247
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC62247%27 HTTP/1.1" 200 None
2026-03-28 12:07:21 [auto1.it] INFO: Scrape type for DC62247: 0
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: XR42745
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: MF61265
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MF61265%27 HTTP/1.1" 200 None
2026-03-28 12:07:21 [auto1.it] INFO: Scrape type for MF61265: 0
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: UW72001
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW72001%27 HTTP/1.1" 200 None
2026-03-28 12:07:21 [auto1.it] INFO: Scrape type for UW72001: 0
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: DS35304
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS35304%27 HTTP/1.1" 200 None
2026-03-28 12:07:21 [auto1.it] INFO: Scrape type for DS35304: 0
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: VZ70094
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: CH35422
2026-03-28 12:07:21 [auto1.it] INFO: Found listing with ID: PK48399
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK48399%27 HTTP/1.1" 200 None
2026-03-28 12:07:22 [auto1.it] INFO: Scrape type for PK48399: 0
2026-03-28 12:07:22 [auto1.it] INFO: Found listing with ID: CG66796
2026-03-28 12:07:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fb2%252Ffbb21e5b327e725908bfb692f2353587%252Fpa%252FWE07120_28a7f393135a670545da1c5d9d35caad.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_28a7f393135a670545da1c5d9d35caad.jpg not downloaded yet
2026-03-28 12:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_178df8cb237eb312e8dc24207d742f9c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/c9/8fc9ee60c102b393c710b4d88be2bc39/pa/FN08703_f9d64a363383c3871119692cd4f3215f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/c9/8fc9ee60c102b393c710b4d88be2bc39/pa/FN08703_68ee134a18c21fcd1c2c658a038df410.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_8d0ff902bc4cd50ea644d78138dee31c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fb2%252Ffbb21e5b327e725908bfb692f2353587%252Fpa%252FWE07120_d5176e5aef9323aac3a6807430311dea.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_d5176e5aef9323aac3a6807430311dea.jpg not downloaded yet
2026-03-28 12:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc38a990>
2026-03-28 12:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebd64a4d-f1d7-5b81-9670-d82009ea60d4/ebd64a4d-f1d7-5b81-9670-d82009ea60d4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fc9%252F8fc9ee60c102b393c710b4d88be2bc39%252Fpa%252FFN08703_f1781ae931fd6286a06aee2be8c111dd.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/c9/8fc9ee60c102b393c710b4d88be2bc39/pa/FN08703_f1781ae931fd6286a06aee2be8c111dd.jpg saved to cache
2026-03-28 12:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ebd64a4d-f1d7-5b81-9670-d82009ea60d4
2026-03-28 12:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/c9/8fc9ee60c102b393c710b4d88be2bc39/pa/FN08703_c6c302df11d4b4a76bb36a233b08f868.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fb2%252Ffbb21e5b327e725908bfb692f2353587%252Fpa%252FWE07120_1e2e1d0c199f90ebaa57dc398b6f3a62.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_1e2e1d0c199f90ebaa57dc398b6f3a62.jpg not downloaded yet
2026-03-28 12:07:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fb2%252Ffbb21e5b327e725908bfb692f2353587%252Fpa%252FWE07120_996e039825bf39e39ec9ad846fbde911.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_996e039825bf39e39ec9ad846fbde911.jpg not downloaded yet
2026-03-28 12:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf36e50>
2026-03-28 12:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f00bd372-daee-5485-9760-fa7b77557807/f00bd372-daee-5485-9760-fa7b77557807_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fb2%252Ffbb21e5b327e725908bfb692f2353587%252Fpa%252FWE07120_178df8cb237eb312e8dc24207d742f9c.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_178df8cb237eb312e8dc24207d742f9c.jpg saved to cache
2026-03-28 12:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f00bd372-daee-5485-9760-fa7b77557807
2026-03-28 12:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd06f050>
2026-03-28 12:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebd64a4d-f1d7-5b81-9670-d82009ea60d4/ebd64a4d-f1d7-5b81-9670-d82009ea60d4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fc9%252F8fc9ee60c102b393c710b4d88be2bc39%252Fpa%252FFN08703_f9d64a363383c3871119692cd4f3215f.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/c9/8fc9ee60c102b393c710b4d88be2bc39/pa/FN08703_f9d64a363383c3871119692cd4f3215f.jpg saved to cache
2026-03-28 12:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ebd64a4d-f1d7-5b81-9670-d82009ea60d4
2026-03-28 12:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd012bd0>
2026-03-28 12:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebd64a4d-f1d7-5b81-9670-d82009ea60d4/ebd64a4d-f1d7-5b81-9670-d82009ea60d4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fc9%252F8fc9ee60c102b393c710b4d88be2bc39%252Fpa%252FFN08703_68ee134a18c21fcd1c2c658a038df410.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/c9/8fc9ee60c102b393c710b4d88be2bc39/pa/FN08703_68ee134a18c21fcd1c2c658a038df410.jpg saved to cache
2026-03-28 12:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ebd64a4d-f1d7-5b81-9670-d82009ea60d4
2026-03-28 12:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5e7fd0>
2026-03-28 12:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f00bd372-daee-5485-9760-fa7b77557807/f00bd372-daee-5485-9760-fa7b77557807_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fb2%252Ffbb21e5b327e725908bfb692f2353587%252Fpa%252FWE07120_8d0ff902bc4cd50ea644d78138dee31c.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_8d0ff902bc4cd50ea644d78138dee31c.jpg saved to cache
2026-03-28 12:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f00bd372-daee-5485-9760-fa7b77557807
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fb2%252Ffbb21e5b327e725908bfb692f2353587%252Fpa%252FWE07120_335a69004a84d7493be5fbe07951958c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_335a69004a84d7493be5fbe07951958c.jpg not downloaded yet
2026-03-28 12:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/c9/8fc9ee60c102b393c710b4d88be2bc39/pa/FN08703_888904ad3231ff1c57b5ecd3d2fe1f67.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_d5176e5aef9323aac3a6807430311dea.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcfb1e10>
2026-03-28 12:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebd64a4d-f1d7-5b81-9670-d82009ea60d4/ebd64a4d-f1d7-5b81-9670-d82009ea60d4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fc9%252F8fc9ee60c102b393c710b4d88be2bc39%252Fpa%252FFN08703_c6c302df11d4b4a76bb36a233b08f868.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/c9/8fc9ee60c102b393c710b4d88be2bc39/pa/FN08703_c6c302df11d4b4a76bb36a233b08f868.jpg saved to cache
2026-03-28 12:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ebd64a4d-f1d7-5b81-9670-d82009ea60d4
2026-03-28 12:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_4ebf409cbce89a3d30424c8127db790d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_f1531522a73ef707d920bc495b3114b1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_ea82b5b32a8b4e6030ac1e770608be59.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_28a7f393135a670545da1c5d9d35caad.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04beed1890>
2026-03-28 12:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebd64a4d-f1d7-5b81-9670-d82009ea60d4/ebd64a4d-f1d7-5b81-9670-d82009ea60d4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fc9%252F8fc9ee60c102b393c710b4d88be2bc39%252Fpa%252FFN08703_888904ad3231ff1c57b5ecd3d2fe1f67.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/c9/8fc9ee60c102b393c710b4d88be2bc39/pa/FN08703_888904ad3231ff1c57b5ecd3d2fe1f67.jpg saved to cache
2026-03-28 12:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ebd64a4d-f1d7-5b81-9670-d82009ea60d4
2026-03-28 12:07:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ebd64a4d-f1d7-5b81-9670-d82009ea60d4, skipping ID generation
2026-03-28 12:07:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebd64a4d-f1d7-5b81-9670-d82009ea60d4 with scrape type 1
2026-03-28 12:07:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ebd64a4d-f1d7-5b81-9670-d82009ea60d4 sending to next pipeline
2026-03-28 12:07:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ebd64a4d-f1d7-5b81-9670-d82009ea60d4, identifier: FN08703
2026-03-28 12:07:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ebd64a4d-f1d7-5b81-9670-d82009ea60d4 with identifier: FN08703
2026-03-28 12:07:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ebd64a4d-f1d7-5b81-9670-d82009ea60d4 with identifier: FN08703
2026-03-28 12:07:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ebd64a4d-f1d7-5b81-9670-d82009ea60d4 with identifier: FN08703 to the API
2026-03-28 12:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8f/c9/8fc9ee60c102b393c710b4d88be2bc39/pa/FN08703_888904ad3231ff1c57b5ecd3d2fe1f67.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:56:13Z',
 'fuel_type': 'petrol',
 'id': 'ebd64a4d-f1d7-5b81-9670-d82009ea60d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN08703',
 'listing': 'auction',
 'location': 'IT, Napoli',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 144609,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebd64a4d-f1d7-5b81-9670-d82009ea60d4/ebd64a4d-f1d7-5b81-9670-d82009ea60d4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/c9/8fc9ee60c102b393c710b4d88be2bc39/pa/FN08703_f1781ae931fd6286a06aee2be8c111dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebd64a4d-f1d7-5b81-9670-d82009ea60d4/ebd64a4d-f1d7-5b81-9670-d82009ea60d4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/c9/8fc9ee60c102b393c710b4d88be2bc39/pa/FN08703_68ee134a18c21fcd1c2c658a038df410.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebd64a4d-f1d7-5b81-9670-d82009ea60d4/ebd64a4d-f1d7-5b81-9670-d82009ea60d4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/c9/8fc9ee60c102b393c710b4d88be2bc39/pa/FN08703_f9d64a363383c3871119692cd4f3215f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebd64a4d-f1d7-5b81-9670-d82009ea60d4/ebd64a4d-f1d7-5b81-9670-d82009ea60d4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52749,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/c9/8fc9ee60c102b393c710b4d88be2bc39/pa/FN08703_c6c302df11d4b4a76bb36a233b08f868.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebd64a4d-f1d7-5b81-9670-d82009ea60d4/ebd64a4d-f1d7-5b81-9670-d82009ea60d4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/c9/8fc9ee60c102b393c710b4d88be2bc39/pa/FN08703_888904ad3231ff1c57b5ecd3d2fe1f67.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i20 1.2 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2014}
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN08703%27 HTTP/1.1" 200 None
2026-03-28 12:07:23 [auto1.it] INFO: Saving data for FN08703: {'created_time': 1774699643.151722, 'last_price_update_time': 1774699643.151734, 'auction_closing_time': 1774886173.0}
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FN08703') HTTP/1.1" 204 0
2026-03-28 12:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_1e2e1d0c199f90ebaa57dc398b6f3a62.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_335a69004a84d7493be5fbe07951958c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PR01158> (referer: https://www.auto1.com/v1/car-details-view/PR01158/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LW42205> (referer: https://www.auto1.com/v1/car-details-view/LW42205/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc2c4290>
2026-03-28 12:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f00bd372-daee-5485-9760-fa7b77557807/f00bd372-daee-5485-9760-fa7b77557807_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fb2%252Ffbb21e5b327e725908bfb692f2353587%252Fpa%252FWE07120_d5176e5aef9323aac3a6807430311dea.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_d5176e5aef9323aac3a6807430311dea.jpg saved to cache
2026-03-28 12:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f00bd372-daee-5485-9760-fa7b77557807
2026-03-28 12:07:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc58d810>
2026-03-28 12:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f00bd372-daee-5485-9760-fa7b77557807/f00bd372-daee-5485-9760-fa7b77557807_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fb2%252Ffbb21e5b327e725908bfb692f2353587%252Fpa%252FWE07120_4ebf409cbce89a3d30424c8127db790d.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_4ebf409cbce89a3d30424c8127db790d.jpg saved to cache
2026-03-28 12:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f00bd372-daee-5485-9760-fa7b77557807
2026-03-28 12:07:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bf1be050>
2026-03-28 12:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f00bd372-daee-5485-9760-fa7b77557807/f00bd372-daee-5485-9760-fa7b77557807_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fb2%252Ffbb21e5b327e725908bfb692f2353587%252Fpa%252FWE07120_f1531522a73ef707d920bc495b3114b1.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_f1531522a73ef707d920bc495b3114b1.jpg saved to cache
2026-03-28 12:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f00bd372-daee-5485-9760-fa7b77557807
2026-03-28 12:07:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bf196450>
2026-03-28 12:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f00bd372-daee-5485-9760-fa7b77557807/f00bd372-daee-5485-9760-fa7b77557807_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fb2%252Ffbb21e5b327e725908bfb692f2353587%252Fpa%252FWE07120_ea82b5b32a8b4e6030ac1e770608be59.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_ea82b5b32a8b4e6030ac1e770608be59.jpg saved to cache
2026-03-28 12:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f00bd372-daee-5485-9760-fa7b77557807
2026-03-28 12:07:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcec8210>
2026-03-28 12:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f00bd372-daee-5485-9760-fa7b77557807/f00bd372-daee-5485-9760-fa7b77557807_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fb2%252Ffbb21e5b327e725908bfb692f2353587%252Fpa%252FWE07120_28a7f393135a670545da1c5d9d35caad.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_28a7f393135a670545da1c5d9d35caad.jpg saved to cache
2026-03-28 12:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f00bd372-daee-5485-9760-fa7b77557807
2026-03-28 12:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf314d0>
2026-03-28 12:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f00bd372-daee-5485-9760-fa7b77557807/f00bd372-daee-5485-9760-fa7b77557807_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fb2%252Ffbb21e5b327e725908bfb692f2353587%252Fpa%252FWE07120_1e2e1d0c199f90ebaa57dc398b6f3a62.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_1e2e1d0c199f90ebaa57dc398b6f3a62.jpg saved to cache
2026-03-28 12:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f00bd372-daee-5485-9760-fa7b77557807
2026-03-28 12:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bef2d190>
2026-03-28 12:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f00bd372-daee-5485-9760-fa7b77557807/f00bd372-daee-5485-9760-fa7b77557807_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fb2%252Ffbb21e5b327e725908bfb692f2353587%252Fpa%252FWE07120_335a69004a84d7493be5fbe07951958c.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_335a69004a84d7493be5fbe07951958c.jpg saved to cache
2026-03-28 12:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f00bd372-daee-5485-9760-fa7b77557807
2026-03-28 12:07:23 [auto1.it] INFO: Channel: 24h | Page: 12 | totalHits: 3674 | hits on page: 40
2026-03-28 12:07:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2689ec9a-2060-500c-8cd9-3fd4e0b0bf65 with identifier: PR01158
2026-03-28 12:07:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2689ec9a-2060-500c-8cd9-3fd4e0b0bf65 with scrape type 1
2026-03-28 12:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2689ec9a-2060-500c-8cd9-3fd4e0b0bf65
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd1%252Fe2d14bac4507330a8123f3a50dd4f165%252Fpa%252FPR01158_159c642433959d04f36e4e0d3844d55d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_159c642433959d04f36e4e0d3844d55d.jpg not downloaded yet
2026-03-28 12:07:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8411cc7c-3beb-5e38-993e-5f97a95aa9ac with identifier: LW42205
2026-03-28 12:07:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8411cc7c-3beb-5e38-993e-5f97a95aa9ac with scrape type 1
2026-03-28 12:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 8411cc7c-3beb-5e38-993e-5f97a95aa9ac
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fbe%252F0dbea07f17a272d94c0c6ab22eb8f85c%252Fpa%252FLW42205_53e77b0e9c2da19a1c5aaf13682a32c1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/be/0dbea07f17a272d94c0c6ab22eb8f85c/pa/LW42205_53e77b0e9c2da19a1c5aaf13682a32c1.jpg not downloaded yet
2026-03-28 12:07:23 [auto1.it] INFO: Found listing with ID: SH43932
2026-03-28 12:07:23 [auto1.it] INFO: Found listing with ID: BG88310
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG88310%27 HTTP/1.1" 200 None
2026-03-28 12:07:23 [auto1.it] INFO: Scrape type for BG88310: 0
2026-03-28 12:07:23 [auto1.it] INFO: Found listing with ID: GC37992
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC37992%27 HTTP/1.1" 200 None
2026-03-28 12:07:23 [auto1.it] INFO: Scrape type for GC37992: 0
2026-03-28 12:07:23 [auto1.it] INFO: Found listing with ID: VD70212
2026-03-28 12:07:23 [auto1.it] INFO: Found listing with ID: RW64625
2026-03-28 12:07:23 [auto1.it] INFO: Found listing with ID: JF27717
2026-03-28 12:07:23 [auto1.it] INFO: Found listing with ID: UM17769
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM17769%27 HTTP/1.1" 200 None
2026-03-28 12:07:23 [auto1.it] INFO: Scrape type for UM17769: 0
2026-03-28 12:07:23 [auto1.it] INFO: Found listing with ID: CK01527
2026-03-28 12:07:23 [auto1.it] INFO: Found listing with ID: BE55711
2026-03-28 12:07:23 [auto1.it] INFO: Found listing with ID: DL42775
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL42775%27 HTTP/1.1" 200 None
2026-03-28 12:07:23 [auto1.it] INFO: Scrape type for DL42775: 0
2026-03-28 12:07:23 [auto1.it] INFO: Found listing with ID: YG18213
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG18213%27 HTTP/1.1" 200 None
2026-03-28 12:07:23 [auto1.it] INFO: Scrape type for YG18213: 0
2026-03-28 12:07:23 [auto1.it] INFO: Found listing with ID: KD20323
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD20323%27 HTTP/1.1" 200 None
2026-03-28 12:07:23 [auto1.it] INFO: Scrape type for KD20323: 0
2026-03-28 12:07:23 [auto1.it] INFO: Found listing with ID: FY53013
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FY53013%27 HTTP/1.1" 200 None
2026-03-28 12:07:23 [auto1.it] INFO: Scrape type for FY53013: 0
2026-03-28 12:07:23 [auto1.it] INFO: Found listing with ID: LR95961
2026-03-28 12:07:23 [auto1.it] INFO: Found listing with ID: XA66823
2026-03-28 12:07:23 [auto1.it] INFO: Found listing with ID: CA11225
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA11225%27 HTTP/1.1" 200 None
2026-03-28 12:07:23 [auto1.it] INFO: Scrape type for CA11225: 0
2026-03-28 12:07:23 [auto1.it] INFO: Found listing with ID: VG20766
2026-03-28 12:07:23 [auto1.it] INFO: Found listing with ID: ST39288
2026-03-28 12:07:23 [auto1.it] INFO: Found listing with ID: YF20115
2026-03-28 12:07:23 [auto1.it] INFO: Found listing with ID: LG27793
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG27793%27 HTTP/1.1" 200 None
2026-03-28 12:07:23 [auto1.it] INFO: Scrape type for LG27793: 0
2026-03-28 12:07:23 [auto1.it] INFO: Found listing with ID: GT16338
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT16338%27 HTTP/1.1" 200 None
2026-03-28 12:07:23 [auto1.it] INFO: Scrape type for GT16338: 0
2026-03-28 12:07:23 [auto1.it] INFO: Found listing with ID: NT95206
2026-03-28 12:07:23 [auto1.it] INFO: Found listing with ID: YD65292
2026-03-28 12:07:23 [auto1.it] INFO: Found listing with ID: FW75637
2026-03-28 12:07:23 [auto1.it] INFO: Found listing with ID: KR30691
2026-03-28 12:07:23 [auto1.it] INFO: Found listing with ID: YP66201
2026-03-28 12:07:23 [auto1.it] INFO: Found listing with ID: WV42889
2026-03-28 12:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV42889%27 HTTP/1.1" 200 None
2026-03-28 12:07:24 [auto1.it] INFO: Scrape type for WV42889: 0
2026-03-28 12:07:24 [auto1.it] INFO: Found listing with ID: BD88975
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD88975%27 HTTP/1.1" 200 None
2026-03-28 12:07:24 [auto1.it] INFO: Scrape type for BD88975: 0
2026-03-28 12:07:24 [auto1.it] INFO: Found listing with ID: XS44510
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XS44510%27 HTTP/1.1" 200 None
2026-03-28 12:07:24 [auto1.it] INFO: Scrape type for XS44510: 0
2026-03-28 12:07:24 [auto1.it] INFO: Found listing with ID: ZA06304
2026-03-28 12:07:24 [auto1.it] INFO: Found listing with ID: PB14031
2026-03-28 12:07:24 [auto1.it] INFO: Found listing with ID: GK30834
2026-03-28 12:07:24 [auto1.it] INFO: Found listing with ID: DF71809
2026-03-28 12:07:24 [auto1.it] INFO: Found listing with ID: LM41534
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM41534%27 HTTP/1.1" 200 None
2026-03-28 12:07:24 [auto1.it] INFO: Scrape type for LM41534: 0
2026-03-28 12:07:24 [auto1.it] INFO: Found listing with ID: WV91656
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV91656%27 HTTP/1.1" 200 None
2026-03-28 12:07:24 [auto1.it] INFO: Scrape type for WV91656: 0
2026-03-28 12:07:24 [auto1.it] INFO: Found listing with ID: ML96661
2026-03-28 12:07:24 [auto1.it] INFO: Found listing with ID: FU47372
2026-03-28 12:07:24 [auto1.it] INFO: Found listing with ID: CS14469
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS14469%27 HTTP/1.1" 200 None
2026-03-28 12:07:24 [auto1.it] INFO: Scrape type for CS14469: 0
2026-03-28 12:07:24 [auto1.it] INFO: Found listing with ID: PE22085
2026-03-28 12:07:24 [auto1.it] INFO: Found listing with ID: DW89993
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW89993%27 HTTP/1.1" 200 None
2026-03-28 12:07:24 [auto1.it] INFO: Scrape type for DW89993: 0
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd1%252Fe2d14bac4507330a8123f3a50dd4f165%252Fpa%252FPR01158_44419fac75492bd90bd66927fae63e2f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_44419fac75492bd90bd66927fae63e2f.jpg not downloaded yet
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fbe%252F0dbea07f17a272d94c0c6ab22eb8f85c%252Fpa%252FLW42205_b8646ccd0db2974322c5415afbbe40ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/be/0dbea07f17a272d94c0c6ab22eb8f85c/pa/LW42205_b8646ccd0db2974322c5415afbbe40ec.jpg not downloaded yet
2026-03-28 12:07:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd1%252Fe2d14bac4507330a8123f3a50dd4f165%252Fpa%252FPR01158_b179788d81ccb07c7ada7efa79a53e5b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_b179788d81ccb07c7ada7efa79a53e5b.jpg not downloaded yet
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fbe%252F0dbea07f17a272d94c0c6ab22eb8f85c%252Fpa%252FLW42205_9f60002754cb03331fb6095e4cd4e794.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/be/0dbea07f17a272d94c0c6ab22eb8f85c/pa/LW42205_9f60002754cb03331fb6095e4cd4e794.jpg not downloaded yet
2026-03-28 12:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PX02634> (referer: https://www.auto1.com/v1/car-details-view/PX02634/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd1%252Fe2d14bac4507330a8123f3a50dd4f165%252Fpa%252FPR01158_d656c5dd53ee4a82306af6d55ec148ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_d656c5dd53ee4a82306af6d55ec148ac.jpg not downloaded yet
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fbe%252F0dbea07f17a272d94c0c6ab22eb8f85c%252Fpa%252FLW42205_e582736adf688ed650435376c07e7d87.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/be/0dbea07f17a272d94c0c6ab22eb8f85c/pa/LW42205_e582736adf688ed650435376c07e7d87.jpg not downloaded yet
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd1%252Fe2d14bac4507330a8123f3a50dd4f165%252Fpa%252FPR01158_51d3d056f56cf8b4568744e60f09b5d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_51d3d056f56cf8b4568744e60f09b5d4.jpg not downloaded yet
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fbe%252F0dbea07f17a272d94c0c6ab22eb8f85c%252Fpa%252FLW42205_3d3e09a82018bddd58ea201880824d91.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/be/0dbea07f17a272d94c0c6ab22eb8f85c/pa/LW42205_3d3e09a82018bddd58ea201880824d91.jpg not downloaded yet
2026-03-28 12:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/be/0dbea07f17a272d94c0c6ab22eb8f85c/pa/LW42205_b8646ccd0db2974322c5415afbbe40ec.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd1%252Fe2d14bac4507330a8123f3a50dd4f165%252Fpa%252FPR01158_2d911742ea611ea2aae2d2634be4c576.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_2d911742ea611ea2aae2d2634be4c576.jpg not downloaded yet
2026-03-28 12:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_44419fac75492bd90bd66927fae63e2f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_159c642433959d04f36e4e0d3844d55d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/be/0dbea07f17a272d94c0c6ab22eb8f85c/pa/LW42205_53e77b0e9c2da19a1c5aaf13682a32c1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_d656c5dd53ee4a82306af6d55ec148ac.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd1%252Fe2d14bac4507330a8123f3a50dd4f165%252Fpa%252FPR01158_d65ea43b7be7773aa9fc6c6d56661a8a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_d65ea43b7be7773aa9fc6c6d56661a8a.jpg not downloaded yet
2026-03-28 12:07:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 650697b6-fd5c-5a6d-8faf-d1e4715ee281 with identifier: PX02634
2026-03-28 12:07:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 650697b6-fd5c-5a6d-8faf-d1e4715ee281 with scrape type 1
2026-03-28 12:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 650697b6-fd5c-5a6d-8faf-d1e4715ee281
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F7d%252F027d3cd9a2a0f210085f058ee808b6aa%252Fpa%252FPX02634_b3a805693e2ec3b26041ff320c06d818.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_b3a805693e2ec3b26041ff320c06d818.jpg not downloaded yet
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd1%252Fe2d14bac4507330a8123f3a50dd4f165%252Fpa%252FPR01158_ca6bef7976a531c5ebb19dd8ac9396ef.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_ca6bef7976a531c5ebb19dd8ac9396ef.jpg not downloaded yet
2026-03-28 12:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/be/0dbea07f17a272d94c0c6ab22eb8f85c/pa/LW42205_9f60002754cb03331fb6095e4cd4e794.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F7d%252F027d3cd9a2a0f210085f058ee808b6aa%252Fpa%252FPX02634_39a2ba1d36426e93aaeff7a7a4a903a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_39a2ba1d36426e93aaeff7a7a4a903a2.jpg not downloaded yet
2026-03-28 12:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/be/0dbea07f17a272d94c0c6ab22eb8f85c/pa/LW42205_3d3e09a82018bddd58ea201880824d91.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd1%252Fe2d14bac4507330a8123f3a50dd4f165%252Fpa%252FPR01158_558078385b919d05445442fa553cb39e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_558078385b919d05445442fa553cb39e.jpg not downloaded yet
2026-03-28 12:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_51d3d056f56cf8b4568744e60f09b5d4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/be/0dbea07f17a272d94c0c6ab22eb8f85c/pa/LW42205_e582736adf688ed650435376c07e7d87.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_b179788d81ccb07c7ada7efa79a53e5b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_2d911742ea611ea2aae2d2634be4c576.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F7d%252F027d3cd9a2a0f210085f058ee808b6aa%252Fpa%252FPX02634_51616c97f29019fc9596cd4a6615fb58.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_51616c97f29019fc9596cd4a6615fb58.jpg not downloaded yet
2026-03-28 12:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CR10860> (referer: https://www.auto1.com/v1/car-details-view/CR10860/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc5c9c90>
2026-03-28 12:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8411cc7c-3beb-5e38-993e-5f97a95aa9ac/8411cc7c-3beb-5e38-993e-5f97a95aa9ac_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fbe%252F0dbea07f17a272d94c0c6ab22eb8f85c%252Fpa%252FLW42205_b8646ccd0db2974322c5415afbbe40ec.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/be/0dbea07f17a272d94c0c6ab22eb8f85c/pa/LW42205_b8646ccd0db2974322c5415afbbe40ec.jpg saved to cache
2026-03-28 12:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8411cc7c-3beb-5e38-993e-5f97a95aa9ac
2026-03-28 12:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd0fb210>
2026-03-28 12:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2689ec9a-2060-500c-8cd9-3fd4e0b0bf65/2689ec9a-2060-500c-8cd9-3fd4e0b0bf65_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd1%252Fe2d14bac4507330a8123f3a50dd4f165%252Fpa%252FPR01158_44419fac75492bd90bd66927fae63e2f.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_44419fac75492bd90bd66927fae63e2f.jpg saved to cache
2026-03-28 12:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2689ec9a-2060-500c-8cd9-3fd4e0b0bf65
2026-03-28 12:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3b2c10>
2026-03-28 12:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2689ec9a-2060-500c-8cd9-3fd4e0b0bf65/2689ec9a-2060-500c-8cd9-3fd4e0b0bf65_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd1%252Fe2d14bac4507330a8123f3a50dd4f165%252Fpa%252FPR01158_159c642433959d04f36e4e0d3844d55d.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_159c642433959d04f36e4e0d3844d55d.jpg saved to cache
2026-03-28 12:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2689ec9a-2060-500c-8cd9-3fd4e0b0bf65
2026-03-28 12:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bce93d50>
2026-03-28 12:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8411cc7c-3beb-5e38-993e-5f97a95aa9ac/8411cc7c-3beb-5e38-993e-5f97a95aa9ac_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fbe%252F0dbea07f17a272d94c0c6ab22eb8f85c%252Fpa%252FLW42205_53e77b0e9c2da19a1c5aaf13682a32c1.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/be/0dbea07f17a272d94c0c6ab22eb8f85c/pa/LW42205_53e77b0e9c2da19a1c5aaf13682a32c1.jpg saved to cache
2026-03-28 12:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8411cc7c-3beb-5e38-993e-5f97a95aa9ac
2026-03-28 12:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc60b410>
2026-03-28 12:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2689ec9a-2060-500c-8cd9-3fd4e0b0bf65/2689ec9a-2060-500c-8cd9-3fd4e0b0bf65_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd1%252Fe2d14bac4507330a8123f3a50dd4f165%252Fpa%252FPR01158_d656c5dd53ee4a82306af6d55ec148ac.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_d656c5dd53ee4a82306af6d55ec148ac.jpg saved to cache
2026-03-28 12:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2689ec9a-2060-500c-8cd9-3fd4e0b0bf65
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd1%252Fe2d14bac4507330a8123f3a50dd4f165%252Fpa%252FPR01158_a461a038ca3127cf539209df4b3adec5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_a461a038ca3127cf539209df4b3adec5.jpg not downloaded yet
2026-03-28 12:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_d65ea43b7be7773aa9fc6c6d56661a8a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F7d%252F027d3cd9a2a0f210085f058ee808b6aa%252Fpa%252FPX02634_56cd91b0f55f1798e679fb4bca3388f7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_56cd91b0f55f1798e679fb4bca3388f7.jpg not downloaded yet
2026-03-28 12:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf9c890>
2026-03-28 12:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8411cc7c-3beb-5e38-993e-5f97a95aa9ac/8411cc7c-3beb-5e38-993e-5f97a95aa9ac_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fbe%252F0dbea07f17a272d94c0c6ab22eb8f85c%252Fpa%252FLW42205_9f60002754cb03331fb6095e4cd4e794.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/be/0dbea07f17a272d94c0c6ab22eb8f85c/pa/LW42205_9f60002754cb03331fb6095e4cd4e794.jpg saved to cache
2026-03-28 12:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8411cc7c-3beb-5e38-993e-5f97a95aa9ac
2026-03-28 12:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf37350>
2026-03-28 12:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8411cc7c-3beb-5e38-993e-5f97a95aa9ac/8411cc7c-3beb-5e38-993e-5f97a95aa9ac_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fbe%252F0dbea07f17a272d94c0c6ab22eb8f85c%252Fpa%252FLW42205_3d3e09a82018bddd58ea201880824d91.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/be/0dbea07f17a272d94c0c6ab22eb8f85c/pa/LW42205_3d3e09a82018bddd58ea201880824d91.jpg saved to cache
2026-03-28 12:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8411cc7c-3beb-5e38-993e-5f97a95aa9ac
2026-03-28 12:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf8a9d0>
2026-03-28 12:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2689ec9a-2060-500c-8cd9-3fd4e0b0bf65/2689ec9a-2060-500c-8cd9-3fd4e0b0bf65_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd1%252Fe2d14bac4507330a8123f3a50dd4f165%252Fpa%252FPR01158_51d3d056f56cf8b4568744e60f09b5d4.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_51d3d056f56cf8b4568744e60f09b5d4.jpg saved to cache
2026-03-28 12:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2689ec9a-2060-500c-8cd9-3fd4e0b0bf65
2026-03-28 12:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcecc610>
2026-03-28 12:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8411cc7c-3beb-5e38-993e-5f97a95aa9ac/8411cc7c-3beb-5e38-993e-5f97a95aa9ac_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fbe%252F0dbea07f17a272d94c0c6ab22eb8f85c%252Fpa%252FLW42205_e582736adf688ed650435376c07e7d87.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/be/0dbea07f17a272d94c0c6ab22eb8f85c/pa/LW42205_e582736adf688ed650435376c07e7d87.jpg saved to cache
2026-03-28 12:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8411cc7c-3beb-5e38-993e-5f97a95aa9ac
2026-03-28 12:07:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8411cc7c-3beb-5e38-993e-5f97a95aa9ac, skipping ID generation
2026-03-28 12:07:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8411cc7c-3beb-5e38-993e-5f97a95aa9ac with scrape type 1
2026-03-28 12:07:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8411cc7c-3beb-5e38-993e-5f97a95aa9ac sending to next pipeline
2026-03-28 12:07:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8411cc7c-3beb-5e38-993e-5f97a95aa9ac, identifier: LW42205
2026-03-28 12:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04cd73a950>
2026-03-28 12:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2689ec9a-2060-500c-8cd9-3fd4e0b0bf65/2689ec9a-2060-500c-8cd9-3fd4e0b0bf65_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd1%252Fe2d14bac4507330a8123f3a50dd4f165%252Fpa%252FPR01158_b179788d81ccb07c7ada7efa79a53e5b.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_b179788d81ccb07c7ada7efa79a53e5b.jpg saved to cache
2026-03-28 12:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2689ec9a-2060-500c-8cd9-3fd4e0b0bf65
2026-03-28 12:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf78ed0>
2026-03-28 12:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2689ec9a-2060-500c-8cd9-3fd4e0b0bf65/2689ec9a-2060-500c-8cd9-3fd4e0b0bf65_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd1%252Fe2d14bac4507330a8123f3a50dd4f165%252Fpa%252FPR01158_2d911742ea611ea2aae2d2634be4c576.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_2d911742ea611ea2aae2d2634be4c576.jpg saved to cache
2026-03-28 12:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2689ec9a-2060-500c-8cd9-3fd4e0b0bf65
2026-03-28 12:07:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1d80ad1-d0bf-5629-997a-5c09972d5593 with identifier: CR10860
2026-03-28 12:07:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1d80ad1-d0bf-5629-997a-5c09972d5593 with scrape type 1
2026-03-28 12:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a1d80ad1-d0bf-5629-997a-5c09972d5593
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F34%252Fe934229f95562fb26f5853955239e59d%252Fpa%252FCR10860_02ff70b2b4f7fcd3ba1d7df22905cdca.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/34/e934229f95562fb26f5853955239e59d/pa/CR10860_02ff70b2b4f7fcd3ba1d7df22905cdca.jpg already downloaded
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F34%252Fe934229f95562fb26f5853955239e59d%252Fpa%252FCR10860_9dbd9c23ce8e60a6a6cbad072647acbd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/34/e934229f95562fb26f5853955239e59d/pa/CR10860_9dbd9c23ce8e60a6a6cbad072647acbd.jpg already downloaded
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F34%252Fe934229f95562fb26f5853955239e59d%252Fpa%252FCR10860_b40c5de3743977d6dd0c7247df815bcf.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/34/e934229f95562fb26f5853955239e59d/pa/CR10860_b40c5de3743977d6dd0c7247df815bcf.jpg already downloaded
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F34%252Fe934229f95562fb26f5853955239e59d%252Fpa%252FCR10860_d67b171bf66b03079a311f5f2099df3f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/34/e934229f95562fb26f5853955239e59d/pa/CR10860_d67b171bf66b03079a311f5f2099df3f.jpg already downloaded
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F34%252Fe934229f95562fb26f5853955239e59d%252Fpa%252FCR10860_2ea91b1c939c8ff6aee2afa2646b16e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/34/e934229f95562fb26f5853955239e59d/pa/CR10860_2ea91b1c939c8ff6aee2afa2646b16e1.jpg already downloaded
2026-03-28 12:07:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a1d80ad1-d0bf-5629-997a-5c09972d5593, identifier: CR10860
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F7d%252F027d3cd9a2a0f210085f058ee808b6aa%252Fpa%252FPX02634_569158f86a425ba3b25ebd1a1e8104d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_569158f86a425ba3b25ebd1a1e8104d2.jpg not downloaded yet
2026-03-28 12:07:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8411cc7c-3beb-5e38-993e-5f97a95aa9ac with identifier: LW42205
2026-03-28 12:07:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8411cc7c-3beb-5e38-993e-5f97a95aa9ac with identifier: LW42205
2026-03-28 12:07:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8411cc7c-3beb-5e38-993e-5f97a95aa9ac with identifier: LW42205 to the API
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0d/be/0dbea07f17a272d94c0c6ab22eb8f85c/pa/LW42205_e582736adf688ed650435376c07e7d87.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:49:20Z',
 'fuel_type': 'diesel',
 'id': '8411cc7c-3beb-5e38-993e-5f97a95aa9ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW42205',
 'listing': 'auction',
 'location': 'IT, Rovereto',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 239073,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8411cc7c-3beb-5e38-993e-5f97a95aa9ac/8411cc7c-3beb-5e38-993e-5f97a95aa9ac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/be/0dbea07f17a272d94c0c6ab22eb8f85c/pa/LW42205_53e77b0e9c2da19a1c5aaf13682a32c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8411cc7c-3beb-5e38-993e-5f97a95aa9ac/8411cc7c-3beb-5e38-993e-5f97a95aa9ac_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/be/0dbea07f17a272d94c0c6ab22eb8f85c/pa/LW42205_b8646ccd0db2974322c5415afbbe40ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8411cc7c-3beb-5e38-993e-5f97a95aa9ac/8411cc7c-3beb-5e38-993e-5f97a95aa9ac_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75037,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/be/0dbea07f17a272d94c0c6ab22eb8f85c/pa/LW42205_9f60002754cb03331fb6095e4cd4e794.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8411cc7c-3beb-5e38-993e-5f97a95aa9ac/8411cc7c-3beb-5e38-993e-5f97a95aa9ac_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/be/0dbea07f17a272d94c0c6ab22eb8f85c/pa/LW42205_e582736adf688ed650435376c07e7d87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8411cc7c-3beb-5e38-993e-5f97a95aa9ac/8411cc7c-3beb-5e38-993e-5f97a95aa9ac_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/be/0dbea07f17a272d94c0c6ab22eb8f85c/pa/LW42205_3d3e09a82018bddd58ea201880824d91.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-09-27',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Panda 1.3 JTD Emotion',
 'transmission': 'manual',
 'trim': 'Emotion',
 'year': 2006}
2026-03-28 12:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW42205%27 HTTP/1.1" 200 None
2026-03-28 12:07:26 [auto1.it] INFO: Saving data for LW42205: {'created_time': 1774699646.002182, 'last_price_update_time': 1774699646.002193, 'auction_closing_time': 1774885760.0}
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LW42205') HTTP/1.1" 204 0
2026-03-28 12:07:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a1d80ad1-d0bf-5629-997a-5c09972d5593 with identifier: CR10860
2026-03-28 12:07:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a1d80ad1-d0bf-5629-997a-5c09972d5593 with identifier: CR10860
2026-03-28 12:07:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a1d80ad1-d0bf-5629-997a-5c09972d5593 with identifier: CR10860 to the API
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CR10860>
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.2L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:01:05Z',
 'fuel_type': 'diesel',
 'id': 'a1d80ad1-d0bf-5629-997a-5c09972d5593',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR10860',
 'listing': 'auction',
 'location': 'IT, Guidonia Monticelio',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 406300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imge9/34/e934229f95562fb26f5853955239e59d/pa/CR10860_02ff70b2b4f7fcd3ba1d7df22905cdca.jpg',
                'https://img-pa.auto1.com/imge9/34/e934229f95562fb26f5853955239e59d/pa/CR10860_9dbd9c23ce8e60a6a6cbad072647acbd.jpg',
                'https://img-pa.auto1.com/imge9/34/e934229f95562fb26f5853955239e59d/pa/CR10860_b40c5de3743977d6dd0c7247df815bcf.jpg',
                'https://img-pa.auto1.com/imge9/34/e934229f95562fb26f5853955239e59d/pa/CR10860_d67b171bf66b03079a311f5f2099df3f.jpg',
                'https://img-pa.auto1.com/imge9/34/e934229f95562fb26f5853955239e59d/pa/CR10860_2ea91b1c939c8ff6aee2afa2646b16e1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1d80ad1-d0bf-5629-997a-5c09972d5593/a1d80ad1-d0bf-5629-997a-5c09972d5593_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/34/e934229f95562fb26f5853955239e59d/pa/CR10860_02ff70b2b4f7fcd3ba1d7df22905cdca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1d80ad1-d0bf-5629-997a-5c09972d5593/a1d80ad1-d0bf-5629-997a-5c09972d5593_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/34/e934229f95562fb26f5853955239e59d/pa/CR10860_9dbd9c23ce8e60a6a6cbad072647acbd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1d80ad1-d0bf-5629-997a-5c09972d5593/a1d80ad1-d0bf-5629-997a-5c09972d5593_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74868,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/34/e934229f95562fb26f5853955239e59d/pa/CR10860_b40c5de3743977d6dd0c7247df815bcf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1d80ad1-d0bf-5629-997a-5c09972d5593/a1d80ad1-d0bf-5629-997a-5c09972d5593_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/34/e934229f95562fb26f5853955239e59d/pa/CR10860_d67b171bf66b03079a311f5f2099df3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1d80ad1-d0bf-5629-997a-5c09972d5593/a1d80ad1-d0bf-5629-997a-5c09972d5593_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/34/e934229f95562fb26f5853955239e59d/pa/CR10860_2ea91b1c939c8ff6aee2afa2646b16e1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-04-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota RAV 4 2.2 Turbodiesel',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR10860%27 HTTP/1.1" 200 None
2026-03-28 12:07:26 [auto1.it] INFO: Saving data for CR10860: {'created_time': 1774699646.456517, 'last_price_update_time': 1774699646.456527, 'auction_closing_time': 1774882865.0}
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CR10860') HTTP/1.1" 204 0
2026-03-28 12:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_ca6bef7976a531c5ebb19dd8ac9396ef.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc485bd0>
2026-03-28 12:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2689ec9a-2060-500c-8cd9-3fd4e0b0bf65/2689ec9a-2060-500c-8cd9-3fd4e0b0bf65_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd1%252Fe2d14bac4507330a8123f3a50dd4f165%252Fpa%252FPR01158_d65ea43b7be7773aa9fc6c6d56661a8a.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_d65ea43b7be7773aa9fc6c6d56661a8a.jpg saved to cache
2026-03-28 12:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2689ec9a-2060-500c-8cd9-3fd4e0b0bf65
2026-03-28 12:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_558078385b919d05445442fa553cb39e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F7d%252F027d3cd9a2a0f210085f058ee808b6aa%252Fpa%252FPX02634_538942e9ea66c8a68da3531e9b8d0106.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_538942e9ea66c8a68da3531e9b8d0106.jpg not downloaded yet
2026-03-28 12:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_996e039825bf39e39ec9ad846fbde911.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_51616c97f29019fc9596cd4a6615fb58.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F7d%252F027d3cd9a2a0f210085f058ee808b6aa%252Fpa%252FPX02634_8edb0d15050d63cc525d199554efa58e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_8edb0d15050d63cc525d199554efa58e.jpg not downloaded yet
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F7d%252F027d3cd9a2a0f210085f058ee808b6aa%252Fpa%252FPX02634_a02fdd74deeae847e873d2aaee378e62.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_a02fdd74deeae847e873d2aaee378e62.jpg not downloaded yet
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F7d%252F027d3cd9a2a0f210085f058ee808b6aa%252Fpa%252FPX02634_23c70cfe5795bd6402a65213e8fd07d5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_23c70cfe5795bd6402a65213e8fd07d5.jpg not downloaded yet
2026-03-28 12:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3eab90>
2026-03-28 12:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2689ec9a-2060-500c-8cd9-3fd4e0b0bf65/2689ec9a-2060-500c-8cd9-3fd4e0b0bf65_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd1%252Fe2d14bac4507330a8123f3a50dd4f165%252Fpa%252FPR01158_ca6bef7976a531c5ebb19dd8ac9396ef.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_ca6bef7976a531c5ebb19dd8ac9396ef.jpg saved to cache
2026-03-28 12:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2689ec9a-2060-500c-8cd9-3fd4e0b0bf65
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F7d%252F027d3cd9a2a0f210085f058ee808b6aa%252Fpa%252FPX02634_900ddc17575c9ea4c1ae4f7aba053a6b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_900ddc17575c9ea4c1ae4f7aba053a6b.jpg not downloaded yet
2026-03-28 12:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc377410>
2026-03-28 12:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2689ec9a-2060-500c-8cd9-3fd4e0b0bf65/2689ec9a-2060-500c-8cd9-3fd4e0b0bf65_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd1%252Fe2d14bac4507330a8123f3a50dd4f165%252Fpa%252FPR01158_558078385b919d05445442fa553cb39e.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_558078385b919d05445442fa553cb39e.jpg saved to cache
2026-03-28 12:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2689ec9a-2060-500c-8cd9-3fd4e0b0bf65
2026-03-28 12:07:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc39e9d0>
2026-03-28 12:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f00bd372-daee-5485-9760-fa7b77557807/f00bd372-daee-5485-9760-fa7b77557807_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fb2%252Ffbb21e5b327e725908bfb692f2353587%252Fpa%252FWE07120_996e039825bf39e39ec9ad846fbde911.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_996e039825bf39e39ec9ad846fbde911.jpg saved to cache
2026-03-28 12:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f00bd372-daee-5485-9760-fa7b77557807
2026-03-28 12:07:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f00bd372-daee-5485-9760-fa7b77557807, skipping ID generation
2026-03-28 12:07:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f00bd372-daee-5485-9760-fa7b77557807 with scrape type 1
2026-03-28 12:07:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f00bd372-daee-5485-9760-fa7b77557807 sending to next pipeline
2026-03-28 12:07:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f00bd372-daee-5485-9760-fa7b77557807, identifier: WE07120
2026-03-28 12:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcecc9d0>
2026-03-28 12:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_650697b6-fd5c-5a6d-8faf-d1e4715ee281/650697b6-fd5c-5a6d-8faf-d1e4715ee281_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F7d%252F027d3cd9a2a0f210085f058ee808b6aa%252Fpa%252FPX02634_51616c97f29019fc9596cd4a6615fb58.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_51616c97f29019fc9596cd4a6615fb58.jpg saved to cache
2026-03-28 12:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 650697b6-fd5c-5a6d-8faf-d1e4715ee281
2026-03-28 12:07:27 [auto1.it] INFO: Channel: 24h | Page: 13 | totalHits: 3674 | hits on page: 40
2026-03-28 12:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_a461a038ca3127cf539209df4b3adec5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f00bd372-daee-5485-9760-fa7b77557807 with identifier: WE07120
2026-03-28 12:07:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f00bd372-daee-5485-9760-fa7b77557807 with identifier: WE07120
2026-03-28 12:07:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f00bd372-daee-5485-9760-fa7b77557807 with identifier: WE07120 to the API
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_996e039825bf39e39ec9ad846fbde911.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 161,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 280,
 'expiration_date': '2026-03-30T15:26:54Z',
 'fuel_type': 'petrol',
 'id': 'f00bd372-daee-5485-9760-fa7b77557807',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE07120',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 179033,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f00bd372-daee-5485-9760-fa7b77557807/f00bd372-daee-5485-9760-fa7b77557807_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2479615,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_4ebf409cbce89a3d30424c8127db790d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f00bd372-daee-5485-9760-fa7b77557807/f00bd372-daee-5485-9760-fa7b77557807_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_178df8cb237eb312e8dc24207d742f9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f00bd372-daee-5485-9760-fa7b77557807/f00bd372-daee-5485-9760-fa7b77557807_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73718,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_8d0ff902bc4cd50ea644d78138dee31c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f00bd372-daee-5485-9760-fa7b77557807/f00bd372-daee-5485-9760-fa7b77557807_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2292100,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_f1531522a73ef707d920bc495b3114b1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f00bd372-daee-5485-9760-fa7b77557807/f00bd372-daee-5485-9760-fa7b77557807_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2416114,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_ea82b5b32a8b4e6030ac1e770608be59.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f00bd372-daee-5485-9760-fa7b77557807/f00bd372-daee-5485-9760-fa7b77557807_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2487215,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_28a7f393135a670545da1c5d9d35caad.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f00bd372-daee-5485-9760-fa7b77557807/f00bd372-daee-5485-9760-fa7b77557807_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55177,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_d5176e5aef9323aac3a6807430311dea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f00bd372-daee-5485-9760-fa7b77557807/f00bd372-daee-5485-9760-fa7b77557807_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_1e2e1d0c199f90ebaa57dc398b6f3a62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f00bd372-daee-5485-9760-fa7b77557807/f00bd372-daee-5485-9760-fa7b77557807_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2518640,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_996e039825bf39e39ec9ad846fbde911.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f00bd372-daee-5485-9760-fa7b77557807/f00bd372-daee-5485-9760-fa7b77557807_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/b2/fbb21e5b327e725908bfb692f2353587/pa/WE07120_335a69004a84d7493be5fbe07951958c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.0 Turbo First Edition',
 'transmission': 'automatic',
 'trim': 'First Edition',
 'year': 2017}
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WE07120%27 HTTP/1.1" 200 None
2026-03-28 12:07:27 [auto1.it] INFO: Saving data for WE07120: {'created_time': 1774699647.401191, 'last_price_update_time': 1774699647.401204, 'auction_closing_time': 1774884414.0}
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WE07120') HTTP/1.1" 204 0
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: LE38713
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: VC63991
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: RC58822
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: TV19217
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: SE41207
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE41207%27 HTTP/1.1" 200 None
2026-03-28 12:07:27 [auto1.it] INFO: Scrape type for SE41207: 0
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: XJ91749
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ91749%27 HTTP/1.1" 200 None
2026-03-28 12:07:27 [auto1.it] INFO: Scrape type for XJ91749: 0
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: KC88615
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: WH06276
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH06276%27 HTTP/1.1" 200 None
2026-03-28 12:07:27 [auto1.it] INFO: Scrape type for WH06276: 0
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: MC37024
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: BG56608
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: MK89859
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MK89859%27 HTTP/1.1" 200 None
2026-03-28 12:07:27 [auto1.it] INFO: Scrape type for MK89859: 0
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: HK94664
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: EU22988
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: NC70942
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: EP92787
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: LY59830
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY59830%27 HTTP/1.1" 200 None
2026-03-28 12:07:27 [auto1.it] INFO: Scrape type for LY59830: 0
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: DC45028
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC45028%27 HTTP/1.1" 200 None
2026-03-28 12:07:27 [auto1.it] INFO: Scrape type for DC45028: 0
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: EZ48642
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ48642%27 HTTP/1.1" 200 None
2026-03-28 12:07:27 [auto1.it] INFO: Scrape type for EZ48642: 0
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: UZ24263
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: GX06628
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: VE78842
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VE78842%27 HTTP/1.1" 200 None
2026-03-28 12:07:27 [auto1.it] INFO: Scrape type for VE78842: 0
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: NY14439
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY14439%27 HTTP/1.1" 200 None
2026-03-28 12:07:27 [auto1.it] INFO: Scrape type for NY14439: 0
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: VS64028
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS64028%27 HTTP/1.1" 200 None
2026-03-28 12:07:27 [auto1.it] INFO: Scrape type for VS64028: 0
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: VC44140
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC44140%27 HTTP/1.1" 200 None
2026-03-28 12:07:27 [auto1.it] INFO: Scrape type for VC44140: 0
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: GM86126
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM86126%27 HTTP/1.1" 200 None
2026-03-28 12:07:27 [auto1.it] INFO: Scrape type for GM86126: 0
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: UZ24825
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ24825%27 HTTP/1.1" 200 None
2026-03-28 12:07:27 [auto1.it] INFO: Scrape type for UZ24825: 0
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: AF82865
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF82865%27 HTTP/1.1" 200 None
2026-03-28 12:07:27 [auto1.it] INFO: Scrape type for AF82865: 0
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: SP92634
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: TE63682
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: BM81624
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: NH43496
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH43496%27 HTTP/1.1" 200 None
2026-03-28 12:07:27 [auto1.it] INFO: Scrape type for NH43496: 0
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: EA01754
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA01754%27 HTTP/1.1" 200 None
2026-03-28 12:07:27 [auto1.it] INFO: Scrape type for EA01754: 0
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: FD12268
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: GA58857
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA58857%27 HTTP/1.1" 200 None
2026-03-28 12:07:27 [auto1.it] INFO: Scrape type for GA58857: 0
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: XK51996
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: UN52705
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN52705%27 HTTP/1.1" 200 None
2026-03-28 12:07:27 [auto1.it] INFO: Scrape type for UN52705: 0
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: HG71843
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG71843%27 HTTP/1.1" 200 None
2026-03-28 12:07:27 [auto1.it] INFO: Scrape type for HG71843: 0
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: CE81369
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE81369%27 HTTP/1.1" 200 None
2026-03-28 12:07:27 [auto1.it] INFO: Scrape type for CE81369: 0
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: XJ87155
2026-03-28 12:07:27 [auto1.it] INFO: Found listing with ID: CE17965
2026-03-28 12:07:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_538942e9ea66c8a68da3531e9b8d0106.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_a02fdd74deeae847e873d2aaee378e62.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd072f90>
2026-03-28 12:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2689ec9a-2060-500c-8cd9-3fd4e0b0bf65/2689ec9a-2060-500c-8cd9-3fd4e0b0bf65_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd1%252Fe2d14bac4507330a8123f3a50dd4f165%252Fpa%252FPR01158_a461a038ca3127cf539209df4b3adec5.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_a461a038ca3127cf539209df4b3adec5.jpg saved to cache
2026-03-28 12:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2689ec9a-2060-500c-8cd9-3fd4e0b0bf65
2026-03-28 12:07:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2689ec9a-2060-500c-8cd9-3fd4e0b0bf65, skipping ID generation
2026-03-28 12:07:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2689ec9a-2060-500c-8cd9-3fd4e0b0bf65 with scrape type 1
2026-03-28 12:07:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2689ec9a-2060-500c-8cd9-3fd4e0b0bf65 sending to next pipeline
2026-03-28 12:07:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2689ec9a-2060-500c-8cd9-3fd4e0b0bf65, identifier: PR01158
2026-03-28 12:07:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2689ec9a-2060-500c-8cd9-3fd4e0b0bf65 with identifier: PR01158
2026-03-28 12:07:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2689ec9a-2060-500c-8cd9-3fd4e0b0bf65 with identifier: PR01158
2026-03-28 12:07:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2689ec9a-2060-500c-8cd9-3fd4e0b0bf65 with identifier: PR01158 to the API
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_a461a038ca3127cf539209df4b3adec5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:33:15Z',
 'fuel_type': 'diesel',
 'id': '2689ec9a-2060-500c-8cd9-3fd4e0b0bf65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR01158',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 132493,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2689ec9a-2060-500c-8cd9-3fd4e0b0bf65/2689ec9a-2060-500c-8cd9-3fd4e0b0bf65_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_159c642433959d04f36e4e0d3844d55d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2689ec9a-2060-500c-8cd9-3fd4e0b0bf65/2689ec9a-2060-500c-8cd9-3fd4e0b0bf65_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_44419fac75492bd90bd66927fae63e2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2689ec9a-2060-500c-8cd9-3fd4e0b0bf65/2689ec9a-2060-500c-8cd9-3fd4e0b0bf65_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_b179788d81ccb07c7ada7efa79a53e5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2689ec9a-2060-500c-8cd9-3fd4e0b0bf65/2689ec9a-2060-500c-8cd9-3fd4e0b0bf65_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_d656c5dd53ee4a82306af6d55ec148ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2689ec9a-2060-500c-8cd9-3fd4e0b0bf65/2689ec9a-2060-500c-8cd9-3fd4e0b0bf65_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_51d3d056f56cf8b4568744e60f09b5d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2689ec9a-2060-500c-8cd9-3fd4e0b0bf65/2689ec9a-2060-500c-8cd9-3fd4e0b0bf65_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_2d911742ea611ea2aae2d2634be4c576.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2689ec9a-2060-500c-8cd9-3fd4e0b0bf65/2689ec9a-2060-500c-8cd9-3fd4e0b0bf65_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61678,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_d65ea43b7be7773aa9fc6c6d56661a8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2689ec9a-2060-500c-8cd9-3fd4e0b0bf65/2689ec9a-2060-500c-8cd9-3fd4e0b0bf65_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_ca6bef7976a531c5ebb19dd8ac9396ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2689ec9a-2060-500c-8cd9-3fd4e0b0bf65/2689ec9a-2060-500c-8cd9-3fd4e0b0bf65_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84777,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_558078385b919d05445442fa553cb39e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2689ec9a-2060-500c-8cd9-3fd4e0b0bf65/2689ec9a-2060-500c-8cd9-3fd4e0b0bf65_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/d1/e2d14bac4507330a8123f3a50dd4f165/pa/PR01158_a461a038ca3127cf539209df4b3adec5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium Business',
 'transmission': 'automatic',
 'trim': 'Titanium Business',
 'year': 2017}
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR01158%27 HTTP/1.1" 200 None
2026-03-28 12:07:28 [auto1.it] INFO: Saving data for PR01158: {'created_time': 1774699648.298545, 'last_price_update_time': 1774699648.298556, 'auction_closing_time': 1774884795.0}
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PR01158') HTTP/1.1" 204 0
2026-03-28 12:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3ff190>
2026-03-28 12:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_650697b6-fd5c-5a6d-8faf-d1e4715ee281/650697b6-fd5c-5a6d-8faf-d1e4715ee281_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F7d%252F027d3cd9a2a0f210085f058ee808b6aa%252Fpa%252FPX02634_538942e9ea66c8a68da3531e9b8d0106.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_538942e9ea66c8a68da3531e9b8d0106.jpg saved to cache
2026-03-28 12:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 650697b6-fd5c-5a6d-8faf-d1e4715ee281
2026-03-28 12:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd070ad0>
2026-03-28 12:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_650697b6-fd5c-5a6d-8faf-d1e4715ee281/650697b6-fd5c-5a6d-8faf-d1e4715ee281_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F7d%252F027d3cd9a2a0f210085f058ee808b6aa%252Fpa%252FPX02634_a02fdd74deeae847e873d2aaee378e62.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_a02fdd74deeae847e873d2aaee378e62.jpg saved to cache
2026-03-28 12:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 650697b6-fd5c-5a6d-8faf-d1e4715ee281
2026-03-28 12:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_900ddc17575c9ea4c1ae4f7aba053a6b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_23c70cfe5795bd6402a65213e8fd07d5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_b3a805693e2ec3b26041ff320c06d818.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_39a2ba1d36426e93aaeff7a7a4a903a2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_56cd91b0f55f1798e679fb4bca3388f7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_569158f86a425ba3b25ebd1a1e8104d2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_8edb0d15050d63cc525d199554efa58e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc3bf890>
2026-03-28 12:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_650697b6-fd5c-5a6d-8faf-d1e4715ee281/650697b6-fd5c-5a6d-8faf-d1e4715ee281_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F7d%252F027d3cd9a2a0f210085f058ee808b6aa%252Fpa%252FPX02634_900ddc17575c9ea4c1ae4f7aba053a6b.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_900ddc17575c9ea4c1ae4f7aba053a6b.jpg saved to cache
2026-03-28 12:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 650697b6-fd5c-5a6d-8faf-d1e4715ee281
2026-03-28 12:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bcf3d190>
2026-03-28 12:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_650697b6-fd5c-5a6d-8faf-d1e4715ee281/650697b6-fd5c-5a6d-8faf-d1e4715ee281_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F7d%252F027d3cd9a2a0f210085f058ee808b6aa%252Fpa%252FPX02634_23c70cfe5795bd6402a65213e8fd07d5.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_23c70cfe5795bd6402a65213e8fd07d5.jpg saved to cache
2026-03-28 12:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 650697b6-fd5c-5a6d-8faf-d1e4715ee281
2026-03-28 12:07:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bf1be950>
2026-03-28 12:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_650697b6-fd5c-5a6d-8faf-d1e4715ee281/650697b6-fd5c-5a6d-8faf-d1e4715ee281_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F7d%252F027d3cd9a2a0f210085f058ee808b6aa%252Fpa%252FPX02634_b3a805693e2ec3b26041ff320c06d818.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_b3a805693e2ec3b26041ff320c06d818.jpg saved to cache
2026-03-28 12:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 650697b6-fd5c-5a6d-8faf-d1e4715ee281
2026-03-28 12:07:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bee8f010>
2026-03-28 12:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_650697b6-fd5c-5a6d-8faf-d1e4715ee281/650697b6-fd5c-5a6d-8faf-d1e4715ee281_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F7d%252F027d3cd9a2a0f210085f058ee808b6aa%252Fpa%252FPX02634_39a2ba1d36426e93aaeff7a7a4a903a2.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_39a2ba1d36426e93aaeff7a7a4a903a2.jpg saved to cache
2026-03-28 12:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 650697b6-fd5c-5a6d-8faf-d1e4715ee281
2026-03-28 12:07:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc573790>
2026-03-28 12:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_650697b6-fd5c-5a6d-8faf-d1e4715ee281/650697b6-fd5c-5a6d-8faf-d1e4715ee281_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F7d%252F027d3cd9a2a0f210085f058ee808b6aa%252Fpa%252FPX02634_56cd91b0f55f1798e679fb4bca3388f7.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_56cd91b0f55f1798e679fb4bca3388f7.jpg saved to cache
2026-03-28 12:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 650697b6-fd5c-5a6d-8faf-d1e4715ee281
2026-03-28 12:07:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bd102cd0>
2026-03-28 12:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_650697b6-fd5c-5a6d-8faf-d1e4715ee281/650697b6-fd5c-5a6d-8faf-d1e4715ee281_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F7d%252F027d3cd9a2a0f210085f058ee808b6aa%252Fpa%252FPX02634_569158f86a425ba3b25ebd1a1e8104d2.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_569158f86a425ba3b25ebd1a1e8104d2.jpg saved to cache
2026-03-28 12:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 650697b6-fd5c-5a6d-8faf-d1e4715ee281
2026-03-28 12:07:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f04bc39d410>
2026-03-28 12:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_650697b6-fd5c-5a6d-8faf-d1e4715ee281/650697b6-fd5c-5a6d-8faf-d1e4715ee281_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F7d%252F027d3cd9a2a0f210085f058ee808b6aa%252Fpa%252FPX02634_8edb0d15050d63cc525d199554efa58e.jpg') HTTP/1.1" 204 0
2026-03-28 12:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_8edb0d15050d63cc525d199554efa58e.jpg saved to cache
2026-03-28 12:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 650697b6-fd5c-5a6d-8faf-d1e4715ee281
2026-03-28 12:07:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 650697b6-fd5c-5a6d-8faf-d1e4715ee281, skipping ID generation
2026-03-28 12:07:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 650697b6-fd5c-5a6d-8faf-d1e4715ee281 with scrape type 1
2026-03-28 12:07:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 650697b6-fd5c-5a6d-8faf-d1e4715ee281 sending to next pipeline
2026-03-28 12:07:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 650697b6-fd5c-5a6d-8faf-d1e4715ee281, identifier: PX02634
2026-03-28 12:07:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 650697b6-fd5c-5a6d-8faf-d1e4715ee281 with identifier: PX02634
2026-03-28 12:07:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 650697b6-fd5c-5a6d-8faf-d1e4715ee281 with identifier: PX02634
2026-03-28 12:07:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 650697b6-fd5c-5a6d-8faf-d1e4715ee281 with identifier: PX02634 to the API
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_8edb0d15050d63cc525d199554efa58e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:16:46Z',
 'fuel_type': 'diesel',
 'id': '650697b6-fd5c-5a6d-8faf-d1e4715ee281',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX02634',
 'listing': 'auction',
 'location': 'IT, Tradein',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 201715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_650697b6-fd5c-5a6d-8faf-d1e4715ee281/650697b6-fd5c-5a6d-8faf-d1e4715ee281_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2805364,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_b3a805693e2ec3b26041ff320c06d818.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_650697b6-fd5c-5a6d-8faf-d1e4715ee281/650697b6-fd5c-5a6d-8faf-d1e4715ee281_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2836357,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_39a2ba1d36426e93aaeff7a7a4a903a2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_650697b6-fd5c-5a6d-8faf-d1e4715ee281/650697b6-fd5c-5a6d-8faf-d1e4715ee281_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_51616c97f29019fc9596cd4a6615fb58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_650697b6-fd5c-5a6d-8faf-d1e4715ee281/650697b6-fd5c-5a6d-8faf-d1e4715ee281_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2599788,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_56cd91b0f55f1798e679fb4bca3388f7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_650697b6-fd5c-5a6d-8faf-d1e4715ee281/650697b6-fd5c-5a6d-8faf-d1e4715ee281_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2611264,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_569158f86a425ba3b25ebd1a1e8104d2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_650697b6-fd5c-5a6d-8faf-d1e4715ee281/650697b6-fd5c-5a6d-8faf-d1e4715ee281_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_538942e9ea66c8a68da3531e9b8d0106.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_650697b6-fd5c-5a6d-8faf-d1e4715ee281/650697b6-fd5c-5a6d-8faf-d1e4715ee281_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2795518,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_8edb0d15050d63cc525d199554efa58e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_650697b6-fd5c-5a6d-8faf-d1e4715ee281/650697b6-fd5c-5a6d-8faf-d1e4715ee281_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110058,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_a02fdd74deeae847e873d2aaee378e62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_650697b6-fd5c-5a6d-8faf-d1e4715ee281/650697b6-fd5c-5a6d-8faf-d1e4715ee281_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_23c70cfe5795bd6402a65213e8fd07d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_650697b6-fd5c-5a6d-8faf-d1e4715ee281/650697b6-fd5c-5a6d-8faf-d1e4715ee281_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/7d/027d3cd9a2a0f210085f058ee808b6aa/pa/PX02634_900ddc17575c9ea4c1ae4f7aba053a6b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-04-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2015}
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PX02634%27 HTTP/1.1" 200 None
2026-03-28 12:07:29 [auto1.it] INFO: Saving data for PX02634: {'created_time': 1774699649.602983, 'last_price_update_time': 1774699649.602995, 'auction_closing_time': 1774883806.0}
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PX02634') HTTP/1.1" 204 0
2026-03-28 12:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:29 [auto1.it] INFO: Channel: 24h | Page: 14 | totalHits: 3675 | hits on page: 40
2026-03-28 12:07:29 [auto1.it] INFO: Found listing with ID: CE17965
2026-03-28 12:07:29 [auto1.it] INFO: Found listing with ID: PJ77887
2026-03-28 12:07:29 [auto1.it] INFO: Found listing with ID: YF31693
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YF31693%27 HTTP/1.1" 200 None
2026-03-28 12:07:29 [auto1.it] INFO: Scrape type for YF31693: 0
2026-03-28 12:07:29 [auto1.it] INFO: Found listing with ID: ZR65304
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR65304%27 HTTP/1.1" 200 None
2026-03-28 12:07:29 [auto1.it] INFO: Scrape type for ZR65304: 0
2026-03-28 12:07:29 [auto1.it] INFO: Found listing with ID: AA46193
2026-03-28 12:07:29 [auto1.it] INFO: Found listing with ID: XC79515
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC79515%27 HTTP/1.1" 200 None
2026-03-28 12:07:29 [auto1.it] INFO: Scrape type for XC79515: 0
2026-03-28 12:07:29 [auto1.it] INFO: Found listing with ID: SH22107
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH22107%27 HTTP/1.1" 200 None
2026-03-28 12:07:29 [auto1.it] INFO: Scrape type for SH22107: 0
2026-03-28 12:07:29 [auto1.it] INFO: Found listing with ID: WD83298
2026-03-28 12:07:29 [auto1.it] INFO: Found listing with ID: XH35372
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH35372%27 HTTP/1.1" 200 None
2026-03-28 12:07:29 [auto1.it] INFO: Scrape type for XH35372: 0
2026-03-28 12:07:29 [auto1.it] INFO: Found listing with ID: GK72900
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GK72900%27 HTTP/1.1" 200 None
2026-03-28 12:07:29 [auto1.it] INFO: Scrape type for GK72900: 0
2026-03-28 12:07:29 [auto1.it] INFO: Found listing with ID: YT99583
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT99583%27 HTTP/1.1" 200 None
2026-03-28 12:07:29 [auto1.it] INFO: Scrape type for YT99583: 0
2026-03-28 12:07:29 [auto1.it] INFO: Found listing with ID: DP98700
2026-03-28 12:07:29 [auto1.it] INFO: Found listing with ID: LZ50355
2026-03-28 12:07:29 [auto1.it] INFO: Found listing with ID: JP72281
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP72281%27 HTTP/1.1" 200 None
2026-03-28 12:07:29 [auto1.it] INFO: Scrape type for JP72281: 0
2026-03-28 12:07:29 [auto1.it] INFO: Found listing with ID: AS43039
2026-03-28 12:07:29 [auto1.it] INFO: Found listing with ID: MH72386
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH72386%27 HTTP/1.1" 200 None
2026-03-28 12:07:29 [auto1.it] INFO: Scrape type for MH72386: 0
2026-03-28 12:07:29 [auto1.it] INFO: Found listing with ID: KX04923
2026-03-28 12:07:29 [auto1.it] INFO: Found listing with ID: XW72958
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW72958%27 HTTP/1.1" 200 None
2026-03-28 12:07:29 [auto1.it] INFO: Scrape type for XW72958: 0
2026-03-28 12:07:29 [auto1.it] INFO: Found listing with ID: WL97433
2026-03-28 12:07:29 [auto1.it] INFO: Found listing with ID: HH27298
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH27298%27 HTTP/1.1" 200 None
2026-03-28 12:07:29 [auto1.it] INFO: Scrape type for HH27298: 0
2026-03-28 12:07:29 [auto1.it] INFO: Found listing with ID: JP60910
2026-03-28 12:07:29 [auto1.it] INFO: Found listing with ID: MS15959
2026-03-28 12:07:29 [auto1.it] INFO: Found listing with ID: UB22158
2026-03-28 12:07:29 [auto1.it] INFO: Found listing with ID: VT21354
2026-03-28 12:07:29 [auto1.it] INFO: Found listing with ID: JZ95441
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ95441%27 HTTP/1.1" 200 None
2026-03-28 12:07:29 [auto1.it] INFO: Scrape type for JZ95441: 0
2026-03-28 12:07:29 [auto1.it] INFO: Found listing with ID: HV53293
2026-03-28 12:07:29 [auto1.it] INFO: Found listing with ID: WZ40427
2026-03-28 12:07:29 [auto1.it] INFO: Found listing with ID: DR60838
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR60838%27 HTTP/1.1" 200 None
2026-03-28 12:07:29 [auto1.it] INFO: Scrape type for DR60838: 0
2026-03-28 12:07:29 [auto1.it] INFO: Found listing with ID: BF36974
2026-03-28 12:07:29 [auto1.it] INFO: Found listing with ID: JP22966
2026-03-28 12:07:29 [auto1.it] INFO: Found listing with ID: LG94393
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG94393%27 HTTP/1.1" 200 None
2026-03-28 12:07:29 [auto1.it] INFO: Scrape type for LG94393: 0
2026-03-28 12:07:29 [auto1.it] INFO: Found listing with ID: HP74394
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP74394%27 HTTP/1.1" 200 None
2026-03-28 12:07:29 [auto1.it] INFO: Scrape type for HP74394: 0
2026-03-28 12:07:29 [auto1.it] INFO: Found listing with ID: ME64112
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME64112%27 HTTP/1.1" 200 None
2026-03-28 12:07:29 [auto1.it] INFO: Scrape type for ME64112: 2
2026-03-28 12:07:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5edd47b-19bf-5c1a-b272-434d95267114 with identifier: ME64112
2026-03-28 12:07:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5edd47b-19bf-5c1a-b272-434d95267114 with scrape type 2
2026-03-28 12:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5edd47b-19bf-5c1a-b272-434d95267114 with scrape type 2
2026-03-28 12:07:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b5edd47b-19bf-5c1a-b272-434d95267114, identifier: ME64112
2026-03-28 12:07:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b5edd47b-19bf-5c1a-b272-434d95267114 with identifier: ME64112
2026-03-28 12:07:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b5edd47b-19bf-5c1a-b272-434d95267114 with identifier: ME64112
2026-03-28 12:07:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b5edd47b-19bf-5c1a-b272-434d95267114 with identifier: ME64112 to the API
2026-03-28 12:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:29:34Z',
 'fuel_type': 'diesel',
 'id': 'b5edd47b-19bf-5c1a-b272-434d95267114',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME64112',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 169289,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-28',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI Advanced',
 'transmission': 'automatic',
 'trim': 'Advanced',
 'year': 2021}
2026-03-28 12:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME64112%27 HTTP/1.1" 200 None
2026-03-28 12:07:30 [auto1.it] INFO: Saving data for ME64112: {'auction_closing_time': 1774715374.0, 'created_time': 1774101943.436948, 'last_price_update_time': 1774699650.454711}
2026-03-28 12:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ME64112') HTTP/1.1" 204 0
2026-03-28 12:07:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:30 [auto1.it] INFO: Found listing with ID: TP47880
2026-03-28 12:07:30 [auto1.it] INFO: Found listing with ID: YJ46375
2026-03-28 12:07:30 [auto1.it] INFO: Found listing with ID: PF40120
2026-03-28 12:07:30 [auto1.it] INFO: Found listing with ID: HX55945
2026-03-28 12:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HX55945%27 HTTP/1.1" 200 None
2026-03-28 12:07:30 [auto1.it] INFO: Scrape type for HX55945: 0
2026-03-28 12:07:30 [auto1.it] INFO: Found listing with ID: HT98795
2026-03-28 12:07:30 [auto1.it] INFO: Found listing with ID: PH46734
2026-03-28 12:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PH46734%27 HTTP/1.1" 200 None
2026-03-28 12:07:30 [auto1.it] INFO: Scrape type for PH46734: 0
2026-03-28 12:07:30 [auto1.it] INFO: Found listing with ID: EE49908
2026-03-28 12:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:31 [auto1.it] INFO: Channel: 24h | Page: 15 | totalHits: 3675 | hits on page: 40
2026-03-28 12:07:31 [auto1.it] INFO: Found listing with ID: VC73391
2026-03-28 12:07:31 [auto1.it] INFO: Found listing with ID: SP57651
2026-03-28 12:07:31 [auto1.it] INFO: Found listing with ID: TP78592
2026-03-28 12:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP78592%27 HTTP/1.1" 200 None
2026-03-28 12:07:31 [auto1.it] INFO: Scrape type for TP78592: 0
2026-03-28 12:07:31 [auto1.it] INFO: Found listing with ID: AJ45475
2026-03-28 12:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AJ45475%27 HTTP/1.1" 200 None
2026-03-28 12:07:31 [auto1.it] INFO: Scrape type for AJ45475: 2
2026-03-28 12:07:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 317288fd-fdc9-50d3-9507-b092bc74421d with identifier: AJ45475
2026-03-28 12:07:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 317288fd-fdc9-50d3-9507-b092bc74421d with scrape type 2
2026-03-28 12:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 317288fd-fdc9-50d3-9507-b092bc74421d with scrape type 2
2026-03-28 12:07:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 317288fd-fdc9-50d3-9507-b092bc74421d, identifier: AJ45475
2026-03-28 12:07:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 317288fd-fdc9-50d3-9507-b092bc74421d with identifier: AJ45475
2026-03-28 12:07:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 317288fd-fdc9-50d3-9507-b092bc74421d with identifier: AJ45475
2026-03-28 12:07:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 317288fd-fdc9-50d3-9507-b092bc74421d with identifier: AJ45475 to the API
2026-03-28 12:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:05:37Z',
 'fuel_type': 'petrol',
 'id': '317288fd-fdc9-50d3-9507-b092bc74421d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ45475',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 199309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-31',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive pure',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive pure',
 'year': 2010}
2026-03-28 12:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AJ45475%27 HTTP/1.1" 200 None
2026-03-28 12:07:32 [auto1.it] INFO: Saving data for AJ45475: {'auction_closing_time': 1774713937.0, 'created_time': 1774516049.531627, 'last_price_update_time': 1774699652.160055}
2026-03-28 12:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AJ45475') HTTP/1.1" 204 0
2026-03-28 12:07:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:32 [auto1.it] INFO: Found listing with ID: EN15125
2026-03-28 12:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN15125%27 HTTP/1.1" 200 None
2026-03-28 12:07:32 [auto1.it] INFO: Scrape type for EN15125: 0
2026-03-28 12:07:32 [auto1.it] INFO: Found listing with ID: GU66352
2026-03-28 12:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU66352%27 HTTP/1.1" 200 None
2026-03-28 12:07:32 [auto1.it] INFO: Scrape type for GU66352: 0
2026-03-28 12:07:32 [auto1.it] INFO: Found listing with ID: KN87461
2026-03-28 12:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KN87461%27 HTTP/1.1" 200 None
2026-03-28 12:07:32 [auto1.it] INFO: Scrape type for KN87461: 0
2026-03-28 12:07:32 [auto1.it] INFO: Found listing with ID: DY04825
2026-03-28 12:07:32 [auto1.it] INFO: Found listing with ID: NE32372
2026-03-28 12:07:32 [auto1.it] INFO: Found listing with ID: XR49803
2026-03-28 12:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR49803%27 HTTP/1.1" 200 None
2026-03-28 12:07:32 [auto1.it] INFO: Scrape type for XR49803: 0
2026-03-28 12:07:32 [auto1.it] INFO: Found listing with ID: WM63577
2026-03-28 12:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM63577%27 HTTP/1.1" 200 None
2026-03-28 12:07:32 [auto1.it] INFO: Scrape type for WM63577: 0
2026-03-28 12:07:32 [auto1.it] INFO: Found listing with ID: GV52121
2026-03-28 12:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV52121%27 HTTP/1.1" 200 None
2026-03-28 12:07:32 [auto1.it] INFO: Scrape type for GV52121: 0
2026-03-28 12:07:32 [auto1.it] INFO: Found listing with ID: JP45376
2026-03-28 12:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP45376%27 HTTP/1.1" 200 None
2026-03-28 12:07:32 [auto1.it] INFO: Scrape type for JP45376: 0
2026-03-28 12:07:32 [auto1.it] INFO: Found listing with ID: US40525
2026-03-28 12:07:32 [auto1.it] INFO: Found listing with ID: MJ86480
2026-03-28 12:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ86480%27 HTTP/1.1" 200 None
2026-03-28 12:07:32 [auto1.it] INFO: Scrape type for MJ86480: 2
2026-03-28 12:07:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71ec26fd-b8ba-5b3a-af60-6e8d08e7039b with identifier: MJ86480
2026-03-28 12:07:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71ec26fd-b8ba-5b3a-af60-6e8d08e7039b with scrape type 2
2026-03-28 12:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71ec26fd-b8ba-5b3a-af60-6e8d08e7039b with scrape type 2
2026-03-28 12:07:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 71ec26fd-b8ba-5b3a-af60-6e8d08e7039b, identifier: MJ86480
2026-03-28 12:07:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 71ec26fd-b8ba-5b3a-af60-6e8d08e7039b with identifier: MJ86480
2026-03-28 12:07:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 71ec26fd-b8ba-5b3a-af60-6e8d08e7039b with identifier: MJ86480
2026-03-28 12:07:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 71ec26fd-b8ba-5b3a-af60-6e8d08e7039b with identifier: MJ86480 to the API
2026-03-28 12:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:10:20Z',
 'fuel_type': 'diesel',
 'id': '71ec26fd-b8ba-5b3a-af60-6e8d08e7039b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ86480',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 207638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-16',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350 d 4Matic Premium',
 'transmission': 'automatic',
 'trim': '4Matic Premium',
 'year': 2018}
2026-03-28 12:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ86480%27 HTTP/1.1" 200 None
2026-03-28 12:07:32 [auto1.it] INFO: Saving data for MJ86480: {'auction_closing_time': 1774714220.0, 'created_time': 1774516048.848869, 'last_price_update_time': 1774699652.882171}
2026-03-28 12:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MJ86480') HTTP/1.1" 204 0
2026-03-28 12:07:32 [auto1.it] INFO: Found listing with ID: ZJ84308
2026-03-28 12:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ84308%27 HTTP/1.1" 200 None
2026-03-28 12:07:32 [auto1.it] INFO: Scrape type for ZJ84308: 0
2026-03-28 12:07:32 [auto1.it] INFO: Found listing with ID: FE03475
2026-03-28 12:07:32 [auto1.it] INFO: Found listing with ID: MW97099
2026-03-28 12:07:32 [auto1.it] INFO: Found listing with ID: EU82988
2026-03-28 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU82988%27 HTTP/1.1" 200 None
2026-03-28 12:07:33 [auto1.it] INFO: Scrape type for EU82988: 0
2026-03-28 12:07:33 [auto1.it] INFO: Found listing with ID: BE00286
2026-03-28 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE00286%27 HTTP/1.1" 200 None
2026-03-28 12:07:33 [auto1.it] INFO: Scrape type for BE00286: 0
2026-03-28 12:07:33 [auto1.it] INFO: Found listing with ID: MC12015
2026-03-28 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MC12015%27 HTTP/1.1" 200 None
2026-03-28 12:07:33 [auto1.it] INFO: Scrape type for MC12015: 0
2026-03-28 12:07:33 [auto1.it] INFO: Found listing with ID: AW62695
2026-03-28 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW62695%27 HTTP/1.1" 200 None
2026-03-28 12:07:33 [auto1.it] INFO: Scrape type for AW62695: 0
2026-03-28 12:07:33 [auto1.it] INFO: Found listing with ID: SK48941
2026-03-28 12:07:33 [auto1.it] INFO: Found listing with ID: CM36340
2026-03-28 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM36340%27 HTTP/1.1" 200 None
2026-03-28 12:07:33 [auto1.it] INFO: Scrape type for CM36340: 0
2026-03-28 12:07:33 [auto1.it] INFO: Found listing with ID: CZ82762
2026-03-28 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ82762%27 HTTP/1.1" 200 None
2026-03-28 12:07:33 [auto1.it] INFO: Scrape type for CZ82762: 0
2026-03-28 12:07:33 [auto1.it] INFO: Found listing with ID: SB02789
2026-03-28 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB02789%27 HTTP/1.1" 200 None
2026-03-28 12:07:33 [auto1.it] INFO: Scrape type for SB02789: 0
2026-03-28 12:07:33 [auto1.it] INFO: Found listing with ID: NA90799
2026-03-28 12:07:33 [auto1.it] INFO: Found listing with ID: YN65512
2026-03-28 12:07:33 [auto1.it] INFO: Found listing with ID: GG10303
2026-03-28 12:07:33 [auto1.it] INFO: Found listing with ID: WR41361
2026-03-28 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR41361%27 HTTP/1.1" 200 None
2026-03-28 12:07:33 [auto1.it] INFO: Scrape type for WR41361: 0
2026-03-28 12:07:33 [auto1.it] INFO: Found listing with ID: SE28120
2026-03-28 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE28120%27 HTTP/1.1" 200 None
2026-03-28 12:07:33 [auto1.it] INFO: Scrape type for SE28120: 0
2026-03-28 12:07:33 [auto1.it] INFO: Found listing with ID: MG07654
2026-03-28 12:07:33 [auto1.it] INFO: Found listing with ID: TP85930
2026-03-28 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP85930%27 HTTP/1.1" 200 None
2026-03-28 12:07:33 [auto1.it] INFO: Scrape type for TP85930: 0
2026-03-28 12:07:33 [auto1.it] INFO: Found listing with ID: MM75159
2026-03-28 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MM75159%27 HTTP/1.1" 200 None
2026-03-28 12:07:33 [auto1.it] INFO: Scrape type for MM75159: 0
2026-03-28 12:07:33 [auto1.it] INFO: Found listing with ID: NK94790
2026-03-28 12:07:33 [auto1.it] INFO: Found listing with ID: TG60202
2026-03-28 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG60202%27 HTTP/1.1" 200 None
2026-03-28 12:07:33 [auto1.it] INFO: Scrape type for TG60202: 0
2026-03-28 12:07:33 [auto1.it] INFO: Found listing with ID: MF09411
2026-03-28 12:07:33 [auto1.it] INFO: Found listing with ID: ZR48768
2026-03-28 12:07:33 [auto1.it] INFO: Found listing with ID: VA22015
2026-03-28 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VA22015%27 HTTP/1.1" 200 None
2026-03-28 12:07:33 [auto1.it] INFO: Scrape type for VA22015: 0
2026-03-28 12:07:33 [auto1.it] INFO: Found listing with ID: RJ99533
2026-03-28 12:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:34 [auto1.it] INFO: Channel: 24h | Page: 16 | totalHits: 3675 | hits on page: 40
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: MW88015
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW88015%27 HTTP/1.1" 200 None
2026-03-28 12:07:34 [auto1.it] INFO: Scrape type for MW88015: 0
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: BZ76072
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ76072%27 HTTP/1.1" 200 None
2026-03-28 12:07:34 [auto1.it] INFO: Scrape type for BZ76072: 0
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: MY09959
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MY09959%27 HTTP/1.1" 200 None
2026-03-28 12:07:34 [auto1.it] INFO: Scrape type for MY09959: 0
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: YD29186
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: TJ75665
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: MC88266
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: NY04443
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: AR32020
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: XU30878
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU30878%27 HTTP/1.1" 200 None
2026-03-28 12:07:34 [auto1.it] INFO: Scrape type for XU30878: 0
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: AZ02575
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: WB02861
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB02861%27 HTTP/1.1" 200 None
2026-03-28 12:07:34 [auto1.it] INFO: Scrape type for WB02861: 0
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: XT03089
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT03089%27 HTTP/1.1" 200 None
2026-03-28 12:07:34 [auto1.it] INFO: Scrape type for XT03089: 0
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: XT75480
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT75480%27 HTTP/1.1" 200 None
2026-03-28 12:07:34 [auto1.it] INFO: Scrape type for XT75480: 0
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: TL73413
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: BZ22923
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ22923%27 HTTP/1.1" 200 None
2026-03-28 12:07:34 [auto1.it] INFO: Scrape type for BZ22923: 0
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: MA55202
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA55202%27 HTTP/1.1" 200 None
2026-03-28 12:07:34 [auto1.it] INFO: Scrape type for MA55202: 0
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: EA99389
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA99389%27 HTTP/1.1" 200 None
2026-03-28 12:07:34 [auto1.it] INFO: Scrape type for EA99389: 0
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: AB06670
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: HD69020
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: DD62614
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD62614%27 HTTP/1.1" 200 None
2026-03-28 12:07:34 [auto1.it] INFO: Scrape type for DD62614: 0
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: YR53882
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: ML25161
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML25161%27 HTTP/1.1" 200 None
2026-03-28 12:07:34 [auto1.it] INFO: Scrape type for ML25161: 0
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: BY85548
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: AH40154
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH40154%27 HTTP/1.1" 200 None
2026-03-28 12:07:34 [auto1.it] INFO: Scrape type for AH40154: 0
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: TZ90103
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: KL07491
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: HH04548
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH04548%27 HTTP/1.1" 200 None
2026-03-28 12:07:34 [auto1.it] INFO: Scrape type for HH04548: 0
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: VY96828
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY96828%27 HTTP/1.1" 200 None
2026-03-28 12:07:34 [auto1.it] INFO: Scrape type for VY96828: 0
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: GS67606
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GS67606%27 HTTP/1.1" 200 None
2026-03-28 12:07:34 [auto1.it] INFO: Scrape type for GS67606: 0
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: PV06948
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV06948%27 HTTP/1.1" 200 None
2026-03-28 12:07:34 [auto1.it] INFO: Scrape type for PV06948: 0
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: ZY29551
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: RU45122
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: SD07666
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: CM02924
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: DA61571
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA61571%27 HTTP/1.1" 200 None
2026-03-28 12:07:34 [auto1.it] INFO: Scrape type for DA61571: 0
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: HY12574
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY12574%27 HTTP/1.1" 200 None
2026-03-28 12:07:34 [auto1.it] INFO: Scrape type for HY12574: 0
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: AR31382
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: BT73754
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: GY59997
2026-03-28 12:07:34 [auto1.it] INFO: Found listing with ID: BR84654
2026-03-28 12:07:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:35 [auto1.it] INFO: Channel: 24h | Page: 17 | totalHits: 3675 | hits on page: 40
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: JG32335
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: HA49893
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: UE49682
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: HZ21842
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HZ21842%27 HTTP/1.1" 200 None
2026-03-28 12:07:35 [auto1.it] INFO: Scrape type for HZ21842: 0
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: VF12324
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: RF17009
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: GR59213
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: SF89201
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SF89201%27 HTTP/1.1" 200 None
2026-03-28 12:07:35 [auto1.it] INFO: Scrape type for SF89201: 0
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: PG27955
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: KD33461
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD33461%27 HTTP/1.1" 200 None
2026-03-28 12:07:35 [auto1.it] INFO: Scrape type for KD33461: 0
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: XY30462
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY30462%27 HTTP/1.1" 200 None
2026-03-28 12:07:35 [auto1.it] INFO: Scrape type for XY30462: 0
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: RF52556
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: UV07226
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UV07226%27 HTTP/1.1" 200 None
2026-03-28 12:07:35 [auto1.it] INFO: Scrape type for UV07226: 0
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: WC70760
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: ZH02661
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: MP98273
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: HK97988
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: SJ75121
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ75121%27 HTTP/1.1" 200 None
2026-03-28 12:07:35 [auto1.it] INFO: Scrape type for SJ75121: 0
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: UU73428
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU73428%27 HTTP/1.1" 200 None
2026-03-28 12:07:35 [auto1.it] INFO: Scrape type for UU73428: 0
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: MM82110
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MM82110%27 HTTP/1.1" 200 None
2026-03-28 12:07:35 [auto1.it] INFO: Scrape type for MM82110: 0
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: JA21524
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: KE50843
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE50843%27 HTTP/1.1" 200 None
2026-03-28 12:07:35 [auto1.it] INFO: Scrape type for KE50843: 0
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: MN43509
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: WU65183
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: FV31205
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: LY31332
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: ZS50484
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS50484%27 HTTP/1.1" 200 None
2026-03-28 12:07:35 [auto1.it] INFO: Scrape type for ZS50484: 0
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: JM76846
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM76846%27 HTTP/1.1" 200 None
2026-03-28 12:07:35 [auto1.it] INFO: Scrape type for JM76846: 0
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: CV87912
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV87912%27 HTTP/1.1" 200 None
2026-03-28 12:07:35 [auto1.it] INFO: Scrape type for CV87912: 0
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: XG74352
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XG74352%27 HTTP/1.1" 200 None
2026-03-28 12:07:35 [auto1.it] INFO: Scrape type for XG74352: 0
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: RH02265
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: PF24041
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PF24041%27 HTTP/1.1" 200 None
2026-03-28 12:07:35 [auto1.it] INFO: Scrape type for PF24041: 0
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: AT64434
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AT64434%27 HTTP/1.1" 200 None
2026-03-28 12:07:35 [auto1.it] INFO: Scrape type for AT64434: 0
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: PC87796
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC87796%27 HTTP/1.1" 200 None
2026-03-28 12:07:35 [auto1.it] INFO: Scrape type for PC87796: 0
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: YS50306
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: UF44040
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UF44040%27 HTTP/1.1" 200 None
2026-03-28 12:07:35 [auto1.it] INFO: Scrape type for UF44040: 0
2026-03-28 12:07:35 [auto1.it] INFO: Found listing with ID: JD40027
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD40027%27 HTTP/1.1" 200 None
2026-03-28 12:07:35 [auto1.it] INFO: Scrape type for JD40027: 2
2026-03-28 12:07:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 690cbb41-747f-58a1-82b6-40ac65ccd4c0 with identifier: JD40027
2026-03-28 12:07:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 690cbb41-747f-58a1-82b6-40ac65ccd4c0 with scrape type 2
2026-03-28 12:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 690cbb41-747f-58a1-82b6-40ac65ccd4c0 with scrape type 2
2026-03-28 12:07:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 690cbb41-747f-58a1-82b6-40ac65ccd4c0, identifier: JD40027
2026-03-28 12:07:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 690cbb41-747f-58a1-82b6-40ac65ccd4c0 with identifier: JD40027
2026-03-28 12:07:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 690cbb41-747f-58a1-82b6-40ac65ccd4c0 with identifier: JD40027
2026-03-28 12:07:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 690cbb41-747f-58a1-82b6-40ac65ccd4c0 with identifier: JD40027 to the API
2026-03-28 12:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:45:28Z',
 'fuel_type': 'diesel',
 'id': '690cbb41-747f-58a1-82b6-40ac65ccd4c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD40027',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 111738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-25',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 CDI Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2012}
2026-03-28 12:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD40027%27 HTTP/1.1" 200 None
2026-03-28 12:07:36 [auto1.it] INFO: Saving data for JD40027: {'auction_closing_time': 1774716328.0, 'created_time': 1774516024.625997, 'last_price_update_time': 1774699656.286795}
2026-03-28 12:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JD40027') HTTP/1.1" 204 0
2026-03-28 12:07:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:36 [auto1.it] INFO: Found listing with ID: ZS91054
2026-03-28 12:07:36 [auto1.it] INFO: Found listing with ID: TK51874
2026-03-28 12:07:36 [auto1.it] INFO: Found listing with ID: LZ51776
2026-03-28 12:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ51776%27 HTTP/1.1" 200 None
2026-03-28 12:07:36 [auto1.it] INFO: Scrape type for LZ51776: 0
2026-03-28 12:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:37 [auto1.it] INFO: Channel: 24h | Page: 18 | totalHits: 3675 | hits on page: 40
2026-03-28 12:07:37 [auto1.it] INFO: Found listing with ID: CK12538
2026-03-28 12:07:37 [auto1.it] INFO: Found listing with ID: GM25035
2026-03-28 12:07:37 [auto1.it] INFO: Found listing with ID: DA21297
2026-03-28 12:07:37 [auto1.it] INFO: Found listing with ID: XH90607
2026-03-28 12:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH90607%27 HTTP/1.1" 200 None
2026-03-28 12:07:37 [auto1.it] INFO: Scrape type for XH90607: 0
2026-03-28 12:07:37 [auto1.it] INFO: Found listing with ID: RZ71540
2026-03-28 12:07:37 [auto1.it] INFO: Found listing with ID: AE71384
2026-03-28 12:07:37 [auto1.it] INFO: Found listing with ID: GV81081
2026-03-28 12:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV81081%27 HTTP/1.1" 200 None
2026-03-28 12:07:37 [auto1.it] INFO: Scrape type for GV81081: 0
2026-03-28 12:07:37 [auto1.it] INFO: Found listing with ID: RL11893
2026-03-28 12:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL11893%27 HTTP/1.1" 200 None
2026-03-28 12:07:37 [auto1.it] INFO: Scrape type for RL11893: 0
2026-03-28 12:07:37 [auto1.it] INFO: Found listing with ID: TT68141
2026-03-28 12:07:37 [auto1.it] INFO: Found listing with ID: WW70884
2026-03-28 12:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW70884%27 HTTP/1.1" 200 None
2026-03-28 12:07:37 [auto1.it] INFO: Scrape type for WW70884: 2
2026-03-28 12:07:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d91054d3-cfd0-559c-8d79-6c2975829d16 with identifier: WW70884
2026-03-28 12:07:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d91054d3-cfd0-559c-8d79-6c2975829d16 with scrape type 2
2026-03-28 12:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d91054d3-cfd0-559c-8d79-6c2975829d16 with scrape type 2
2026-03-28 12:07:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d91054d3-cfd0-559c-8d79-6c2975829d16, identifier: WW70884
2026-03-28 12:07:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d91054d3-cfd0-559c-8d79-6c2975829d16 with identifier: WW70884
2026-03-28 12:07:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d91054d3-cfd0-559c-8d79-6c2975829d16 with identifier: WW70884
2026-03-28 12:07:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d91054d3-cfd0-559c-8d79-6c2975829d16 with identifier: WW70884 to the API
2026-03-28 12:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:47:45Z',
 'fuel_type': 'diesel',
 'id': 'd91054d3-cfd0-559c-8d79-6c2975829d16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW70884',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 190237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-19',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic Exclusive',
 'transmission': 'automatic',
 'trim': '4Matic Exclusive',
 'year': 2018}
2026-03-28 12:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW70884%27 HTTP/1.1" 200 None
2026-03-28 12:07:37 [auto1.it] INFO: Saving data for WW70884: {'auction_closing_time': 1774716465.0, 'created_time': 1774516017.294527, 'last_price_update_time': 1774699657.820367}
2026-03-28 12:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WW70884') HTTP/1.1" 204 0
2026-03-28 12:07:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:37 [auto1.it] INFO: Found listing with ID: KT78402
2026-03-28 12:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT78402%27 HTTP/1.1" 200 None
2026-03-28 12:07:37 [auto1.it] INFO: Scrape type for KT78402: 2
2026-03-28 12:07:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 190b0701-108f-56fe-b0ca-61e96a863b5b with identifier: KT78402
2026-03-28 12:07:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 190b0701-108f-56fe-b0ca-61e96a863b5b with scrape type 2
2026-03-28 12:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 190b0701-108f-56fe-b0ca-61e96a863b5b with scrape type 2
2026-03-28 12:07:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 190b0701-108f-56fe-b0ca-61e96a863b5b, identifier: KT78402
2026-03-28 12:07:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 190b0701-108f-56fe-b0ca-61e96a863b5b with identifier: KT78402
2026-03-28 12:07:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 190b0701-108f-56fe-b0ca-61e96a863b5b with identifier: KT78402
2026-03-28 12:07:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 190b0701-108f-56fe-b0ca-61e96a863b5b with identifier: KT78402 to the API
2026-03-28 12:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:51:39Z',
 'fuel_type': 'diesel',
 'id': '190b0701-108f-56fe-b0ca-61e96a863b5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT78402',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 237934,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-28',
 'seller_name': None,
 'title': 'Ford Grand C-Max 1.6 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2013}
2026-03-28 12:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT78402%27 HTTP/1.1" 200 None
2026-03-28 12:07:38 [auto1.it] INFO: Saving data for KT78402: {'auction_closing_time': 1774716699.0, 'created_time': 1774516045.676705, 'last_price_update_time': 1774699658.323917}
2026-03-28 12:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KT78402') HTTP/1.1" 204 0
2026-03-28 12:07:38 [auto1.it] INFO: Found listing with ID: HE90318
2026-03-28 12:07:38 [auto1.it] INFO: Found listing with ID: KY18822
2026-03-28 12:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KY18822%27 HTTP/1.1" 200 None
2026-03-28 12:07:38 [auto1.it] INFO: Scrape type for KY18822: 0
2026-03-28 12:07:38 [auto1.it] INFO: Found listing with ID: LR80545
2026-03-28 12:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR80545%27 HTTP/1.1" 200 None
2026-03-28 12:07:38 [auto1.it] INFO: Scrape type for LR80545: 0
2026-03-28 12:07:38 [auto1.it] INFO: Found listing with ID: VK83291
2026-03-28 12:07:38 [auto1.it] INFO: Found listing with ID: KC76044
2026-03-28 12:07:38 [auto1.it] INFO: Found listing with ID: EJ70164
2026-03-28 12:07:38 [auto1.it] INFO: Found listing with ID: FB75949
2026-03-28 12:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB75949%27 HTTP/1.1" 200 None
2026-03-28 12:07:38 [auto1.it] INFO: Scrape type for FB75949: 0
2026-03-28 12:07:38 [auto1.it] INFO: Found listing with ID: JZ08604
2026-03-28 12:07:38 [auto1.it] INFO: Found listing with ID: CX77034
2026-03-28 12:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CX77034%27 HTTP/1.1" 200 None
2026-03-28 12:07:38 [auto1.it] INFO: Scrape type for CX77034: 0
2026-03-28 12:07:38 [auto1.it] INFO: Found listing with ID: AL33371
2026-03-28 12:07:38 [auto1.it] INFO: Found listing with ID: SG14661
2026-03-28 12:07:38 [auto1.it] INFO: Found listing with ID: ZE89719
2026-03-28 12:07:38 [auto1.it] INFO: Found listing with ID: VP48054
2026-03-28 12:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP48054%27 HTTP/1.1" 200 None
2026-03-28 12:07:38 [auto1.it] INFO: Scrape type for VP48054: 0
2026-03-28 12:07:38 [auto1.it] INFO: Found listing with ID: FX33898
2026-03-28 12:07:38 [auto1.it] INFO: Found listing with ID: SD16810
2026-03-28 12:07:38 [auto1.it] INFO: Found listing with ID: CV59379
2026-03-28 12:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV59379%27 HTTP/1.1" 200 None
2026-03-28 12:07:38 [auto1.it] INFO: Scrape type for CV59379: 0
2026-03-28 12:07:38 [auto1.it] INFO: Found listing with ID: EK65593
2026-03-28 12:07:38 [auto1.it] INFO: Found listing with ID: JS42398
2026-03-28 12:07:38 [auto1.it] INFO: Found listing with ID: SF23261
2026-03-28 12:07:38 [auto1.it] INFO: Found listing with ID: AA72149
2026-03-28 12:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AA72149%27 HTTP/1.1" 200 None
2026-03-28 12:07:38 [auto1.it] INFO: Scrape type for AA72149: 0
2026-03-28 12:07:38 [auto1.it] INFO: Found listing with ID: PR97766
2026-03-28 12:07:38 [auto1.it] INFO: Found listing with ID: NT87512
2026-03-28 12:07:38 [auto1.it] INFO: Found listing with ID: TT47186
2026-03-28 12:07:38 [auto1.it] INFO: Found listing with ID: RL69129
2026-03-28 12:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL69129%27 HTTP/1.1" 200 None
2026-03-28 12:07:38 [auto1.it] INFO: Scrape type for RL69129: 0
2026-03-28 12:07:38 [auto1.it] INFO: Found listing with ID: AN76341
2026-03-28 12:07:38 [auto1.it] INFO: Found listing with ID: VW08659
2026-03-28 12:07:38 [auto1.it] INFO: Found listing with ID: BE85602
2026-03-28 12:07:38 [auto1.it] INFO: Found listing with ID: AL22636
2026-03-28 12:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL22636%27 HTTP/1.1" 200 None
2026-03-28 12:07:38 [auto1.it] INFO: Scrape type for AL22636: 0
2026-03-28 12:07:38 [auto1.it] INFO: Found listing with ID: WA74830
2026-03-28 12:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA74830%27 HTTP/1.1" 200 None
2026-03-28 12:07:38 [auto1.it] INFO: Scrape type for WA74830: 2
2026-03-28 12:07:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a558e35a-90c5-5313-87c3-0f060f6557d1 with identifier: WA74830
2026-03-28 12:07:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a558e35a-90c5-5313-87c3-0f060f6557d1 with scrape type 2
2026-03-28 12:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a558e35a-90c5-5313-87c3-0f060f6557d1 with scrape type 2
2026-03-28 12:07:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a558e35a-90c5-5313-87c3-0f060f6557d1, identifier: WA74830
2026-03-28 12:07:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a558e35a-90c5-5313-87c3-0f060f6557d1 with identifier: WA74830
2026-03-28 12:07:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a558e35a-90c5-5313-87c3-0f060f6557d1 with identifier: WA74830
2026-03-28 12:07:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a558e35a-90c5-5313-87c3-0f060f6557d1 with identifier: WA74830 to the API
2026-03-28 12:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:12:00Z',
 'fuel_type': 'diesel',
 'id': 'a558e35a-90c5-5313-87c3-0f060f6557d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA74830',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Cherokee',
 'odometer': 293925,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-28',
 'seller_name': None,
 'title': 'Jeep Cherokee 2.2 M-Jet Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2017}
2026-03-28 12:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA74830%27 HTTP/1.1" 200 None
2026-03-28 12:07:38 [auto1.it] INFO: Saving data for WA74830: {'auction_closing_time': 1774714320.0, 'created_time': 1774515967.967231, 'last_price_update_time': 1774699658.952129}
2026-03-28 12:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WA74830') HTTP/1.1" 204 0
2026-03-28 12:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:40 [auto1.it] INFO: Channel: 24h | Page: 19 | totalHits: 3675 | hits on page: 40
2026-03-28 12:07:40 [auto1.it] INFO: Found listing with ID: YM41293
2026-03-28 12:07:40 [auto1.it] INFO: Found listing with ID: UH24894
2026-03-28 12:07:40 [auto1.it] INFO: Found listing with ID: JK70012
2026-03-28 12:07:40 [auto1.it] INFO: Found listing with ID: FF54674
2026-03-28 12:07:40 [auto1.it] INFO: Found listing with ID: FV08764
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FV08764%27 HTTP/1.1" 200 None
2026-03-28 12:07:40 [auto1.it] INFO: Scrape type for FV08764: 0
2026-03-28 12:07:40 [auto1.it] INFO: Found listing with ID: RF58149
2026-03-28 12:07:40 [auto1.it] INFO: Found listing with ID: MY00561
2026-03-28 12:07:40 [auto1.it] INFO: Found listing with ID: KM79113
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM79113%27 HTTP/1.1" 200 None
2026-03-28 12:07:40 [auto1.it] INFO: Scrape type for KM79113: 0
2026-03-28 12:07:40 [auto1.it] INFO: Found listing with ID: RA21109
2026-03-28 12:07:40 [auto1.it] INFO: Found listing with ID: SC24235
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC24235%27 HTTP/1.1" 200 None
2026-03-28 12:07:40 [auto1.it] INFO: Scrape type for SC24235: 0
2026-03-28 12:07:40 [auto1.it] INFO: Found listing with ID: PC98849
2026-03-28 12:07:40 [auto1.it] INFO: Found listing with ID: UT67830
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT67830%27 HTTP/1.1" 200 None
2026-03-28 12:07:40 [auto1.it] INFO: Scrape type for UT67830: 0
2026-03-28 12:07:40 [auto1.it] INFO: Found listing with ID: KS82343
2026-03-28 12:07:40 [auto1.it] INFO: Found listing with ID: DX23883
2026-03-28 12:07:40 [auto1.it] INFO: Found listing with ID: YB28185
2026-03-28 12:07:40 [auto1.it] INFO: Found listing with ID: UJ22740
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UJ22740%27 HTTP/1.1" 200 None
2026-03-28 12:07:40 [auto1.it] INFO: Scrape type for UJ22740: 0
2026-03-28 12:07:40 [auto1.it] INFO: Found listing with ID: JV82162
2026-03-28 12:07:40 [auto1.it] INFO: Found listing with ID: DE25222
2026-03-28 12:07:40 [auto1.it] INFO: Found listing with ID: UX20076
2026-03-28 12:07:40 [auto1.it] INFO: Found listing with ID: SN27991
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN27991%27 HTTP/1.1" 200 None
2026-03-28 12:07:40 [auto1.it] INFO: Scrape type for SN27991: 0
2026-03-28 12:07:40 [auto1.it] INFO: Found listing with ID: MD06085
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD06085%27 HTTP/1.1" 200 None
2026-03-28 12:07:40 [auto1.it] INFO: Scrape type for MD06085: 0
2026-03-28 12:07:40 [auto1.it] INFO: Found listing with ID: SS79463
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS79463%27 HTTP/1.1" 200 None
2026-03-28 12:07:40 [auto1.it] INFO: Scrape type for SS79463: 0
2026-03-28 12:07:40 [auto1.it] INFO: Found listing with ID: MC91027
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MC91027%27 HTTP/1.1" 200 None
2026-03-28 12:07:40 [auto1.it] INFO: Scrape type for MC91027: 0
2026-03-28 12:07:40 [auto1.it] INFO: Found listing with ID: ZT24838
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT24838%27 HTTP/1.1" 200 None
2026-03-28 12:07:40 [auto1.it] INFO: Scrape type for ZT24838: 0
2026-03-28 12:07:40 [auto1.it] INFO: Found listing with ID: JK02005
2026-03-28 12:07:40 [auto1.it] INFO: Found listing with ID: RB72441
2026-03-28 12:07:40 [auto1.it] INFO: Found listing with ID: EC66438
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC66438%27 HTTP/1.1" 200 None
2026-03-28 12:07:40 [auto1.it] INFO: Scrape type for EC66438: 2
2026-03-28 12:07:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be2c0adf-b03c-5ed4-adf8-3bca33f1d675 with identifier: EC66438
2026-03-28 12:07:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be2c0adf-b03c-5ed4-adf8-3bca33f1d675 with scrape type 2
2026-03-28 12:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be2c0adf-b03c-5ed4-adf8-3bca33f1d675 with scrape type 2
2026-03-28 12:07:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: be2c0adf-b03c-5ed4-adf8-3bca33f1d675, identifier: EC66438
2026-03-28 12:07:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: be2c0adf-b03c-5ed4-adf8-3bca33f1d675 with identifier: EC66438
2026-03-28 12:07:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: be2c0adf-b03c-5ed4-adf8-3bca33f1d675 with identifier: EC66438
2026-03-28 12:07:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: be2c0adf-b03c-5ed4-adf8-3bca33f1d675 with identifier: EC66438 to the API
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:25:37Z',
 'fuel_type': 'diesel',
 'id': 'be2c0adf-b03c-5ed4-adf8-3bca33f1d675',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC66438',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 133265,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-05',
 'seller_name': None,
 'title': 'Fiat 500X 1.3 M-Jet City Cross',
 'transmission': 'manual',
 'trim': 'City Cross',
 'year': 2017}
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC66438%27 HTTP/1.1" 200 None
2026-03-28 12:07:40 [auto1.it] INFO: Saving data for EC66438: {'auction_closing_time': 1774715137.0, 'created_time': 1773868110.231897, 'last_price_update_time': 1774699660.795124}
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EC66438') HTTP/1.1" 204 0
2026-03-28 12:07:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:40 [auto1.it] INFO: Found listing with ID: VK05865
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK05865%27 HTTP/1.1" 200 None
2026-03-28 12:07:40 [auto1.it] INFO: Scrape type for VK05865: 0
2026-03-28 12:07:40 [auto1.it] INFO: Found listing with ID: WR22265
2026-03-28 12:07:40 [auto1.it] INFO: Found listing with ID: UN16063
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN16063%27 HTTP/1.1" 200 None
2026-03-28 12:07:40 [auto1.it] INFO: Scrape type for UN16063: 0
2026-03-28 12:07:40 [auto1.it] INFO: Found listing with ID: YA33323
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA33323%27 HTTP/1.1" 200 None
2026-03-28 12:07:40 [auto1.it] INFO: Scrape type for YA33323: 0
2026-03-28 12:07:40 [auto1.it] INFO: Found listing with ID: EM46556
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EM46556%27 HTTP/1.1" 200 None
2026-03-28 12:07:40 [auto1.it] INFO: Scrape type for EM46556: 0
2026-03-28 12:07:40 [auto1.it] INFO: Found listing with ID: ZP43872
2026-03-28 12:07:40 [auto1.it] INFO: Found listing with ID: CP55584
2026-03-28 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP55584%27 HTTP/1.1" 200 None
2026-03-28 12:07:41 [auto1.it] INFO: Scrape type for CP55584: 0
2026-03-28 12:07:41 [auto1.it] INFO: Found listing with ID: VT45573
2026-03-28 12:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VT45573%27 HTTP/1.1" 200 None
2026-03-28 12:07:41 [auto1.it] INFO: Scrape type for VT45573: 0
2026-03-28 12:07:41 [auto1.it] INFO: Found listing with ID: MU13564
2026-03-28 12:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU13564%27 HTTP/1.1" 200 None
2026-03-28 12:07:41 [auto1.it] INFO: Scrape type for MU13564: 0
2026-03-28 12:07:41 [auto1.it] INFO: Found listing with ID: YY01932
2026-03-28 12:07:41 [auto1.it] INFO: Found listing with ID: UD16121
2026-03-28 12:07:41 [auto1.it] INFO: Found listing with ID: EC11217
2026-03-28 12:07:41 [auto1.it] INFO: Found listing with ID: XV48493
2026-03-28 12:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV48493%27 HTTP/1.1" 200 None
2026-03-28 12:07:41 [auto1.it] INFO: Scrape type for XV48493: 0
2026-03-28 12:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:42 [auto1.it] INFO: Channel: 24h | Page: 20 | totalHits: 3675 | hits on page: 40
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: MD24560
2026-03-28 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD24560%27 HTTP/1.1" 200 None
2026-03-28 12:07:42 [auto1.it] INFO: Scrape type for MD24560: 0
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: XT99009
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: LC07756
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: EV86886
2026-03-28 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV86886%27 HTTP/1.1" 200 None
2026-03-28 12:07:42 [auto1.it] INFO: Scrape type for EV86886: 0
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: SK38422
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: UR82213
2026-03-28 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR82213%27 HTTP/1.1" 200 None
2026-03-28 12:07:42 [auto1.it] INFO: Scrape type for UR82213: 0
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: TP47209
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: ZA41096
2026-03-28 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZA41096%27 HTTP/1.1" 200 None
2026-03-28 12:07:42 [auto1.it] INFO: Scrape type for ZA41096: 0
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: HS75117
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: US82962
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: NU85167
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: ZY01206
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: NL99769
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: MS47082
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: UB37048
2026-03-28 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB37048%27 HTTP/1.1" 200 None
2026-03-28 12:07:42 [auto1.it] INFO: Scrape type for UB37048: 0
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: CF64613
2026-03-28 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CF64613%27 HTTP/1.1" 200 None
2026-03-28 12:07:42 [auto1.it] INFO: Scrape type for CF64613: 0
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: RE73183
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: TY88258
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: YJ50893
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: FE47038
2026-03-28 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FE47038%27 HTTP/1.1" 200 None
2026-03-28 12:07:42 [auto1.it] INFO: Scrape type for FE47038: 0
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: KS22077
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: DF42312
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: EX36920
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: XZ56129
2026-03-28 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XZ56129%27 HTTP/1.1" 200 None
2026-03-28 12:07:42 [auto1.it] INFO: Scrape type for XZ56129: 0
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: WD53289
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: EU76954
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: YU54798
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: RK45899
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: KM82179
2026-03-28 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM82179%27 HTTP/1.1" 200 None
2026-03-28 12:07:42 [auto1.it] INFO: Scrape type for KM82179: 0
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: WA14030
2026-03-28 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA14030%27 HTTP/1.1" 200 None
2026-03-28 12:07:42 [auto1.it] INFO: Scrape type for WA14030: 0
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: FJ36281
2026-03-28 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ36281%27 HTTP/1.1" 200 None
2026-03-28 12:07:42 [auto1.it] INFO: Scrape type for FJ36281: 0
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: SC05830
2026-03-28 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC05830%27 HTTP/1.1" 200 None
2026-03-28 12:07:42 [auto1.it] INFO: Scrape type for SC05830: 0
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: DX52921
2026-03-28 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX52921%27 HTTP/1.1" 200 None
2026-03-28 12:07:42 [auto1.it] INFO: Scrape type for DX52921: 0
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: TG05681
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: ZJ11157
2026-03-28 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ11157%27 HTTP/1.1" 200 None
2026-03-28 12:07:42 [auto1.it] INFO: Scrape type for ZJ11157: 0
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: FG85862
2026-03-28 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG85862%27 HTTP/1.1" 200 None
2026-03-28 12:07:42 [auto1.it] INFO: Scrape type for FG85862: 0
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: SH24960
2026-03-28 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH24960%27 HTTP/1.1" 200 None
2026-03-28 12:07:42 [auto1.it] INFO: Scrape type for SH24960: 0
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: WR20789
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: XY73038
2026-03-28 12:07:42 [auto1.it] INFO: Found listing with ID: TK53428
2026-03-28 12:07:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:43 [auto1.it] INFO: Channel: 24h | Page: 21 | totalHits: 3675 | hits on page: 40
2026-03-28 12:07:43 [auto1.it] INFO: Found listing with ID: NT25208
2026-03-28 12:07:43 [auto1.it] INFO: Found listing with ID: ZM39630
2026-03-28 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM39630%27 HTTP/1.1" 200 None
2026-03-28 12:07:43 [auto1.it] INFO: Scrape type for ZM39630: 0
2026-03-28 12:07:43 [auto1.it] INFO: Found listing with ID: SK44334
2026-03-28 12:07:43 [auto1.it] INFO: Found listing with ID: DP62662
2026-03-28 12:07:43 [auto1.it] INFO: Found listing with ID: XD24823
2026-03-28 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD24823%27 HTTP/1.1" 200 None
2026-03-28 12:07:43 [auto1.it] INFO: Scrape type for XD24823: 0
2026-03-28 12:07:43 [auto1.it] INFO: Found listing with ID: NB02021
2026-03-28 12:07:43 [auto1.it] INFO: Found listing with ID: VC74933
2026-03-28 12:07:43 [auto1.it] INFO: Found listing with ID: UT52795
2026-03-28 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT52795%27 HTTP/1.1" 200 None
2026-03-28 12:07:43 [auto1.it] INFO: Scrape type for UT52795: 0
2026-03-28 12:07:43 [auto1.it] INFO: Found listing with ID: MX71384
2026-03-28 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX71384%27 HTTP/1.1" 200 None
2026-03-28 12:07:43 [auto1.it] INFO: Scrape type for MX71384: 0
2026-03-28 12:07:43 [auto1.it] INFO: Found listing with ID: EB41992
2026-03-28 12:07:43 [auto1.it] INFO: Found listing with ID: ZF01479
2026-03-28 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF01479%27 HTTP/1.1" 200 None
2026-03-28 12:07:43 [auto1.it] INFO: Scrape type for ZF01479: 0
2026-03-28 12:07:43 [auto1.it] INFO: Found listing with ID: CT94493
2026-03-28 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT94493%27 HTTP/1.1" 200 None
2026-03-28 12:07:43 [auto1.it] INFO: Scrape type for CT94493: 0
2026-03-28 12:07:43 [auto1.it] INFO: Found listing with ID: TZ83635
2026-03-28 12:07:43 [auto1.it] INFO: Found listing with ID: BS51992
2026-03-28 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BS51992%27 HTTP/1.1" 200 None
2026-03-28 12:07:43 [auto1.it] INFO: Scrape type for BS51992: 0
2026-03-28 12:07:43 [auto1.it] INFO: Found listing with ID: WJ94048
2026-03-28 12:07:43 [auto1.it] INFO: Found listing with ID: ZU06634
2026-03-28 12:07:43 [auto1.it] INFO: Found listing with ID: WE26685
2026-03-28 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WE26685%27 HTTP/1.1" 200 None
2026-03-28 12:07:43 [auto1.it] INFO: Scrape type for WE26685: 0
2026-03-28 12:07:43 [auto1.it] INFO: Found listing with ID: NU40150
2026-03-28 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NU40150%27 HTTP/1.1" 200 None
2026-03-28 12:07:43 [auto1.it] INFO: Scrape type for NU40150: 0
2026-03-28 12:07:43 [auto1.it] INFO: Found listing with ID: TL80990
2026-03-28 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL80990%27 HTTP/1.1" 200 None
2026-03-28 12:07:43 [auto1.it] INFO: Scrape type for TL80990: 0
2026-03-28 12:07:43 [auto1.it] INFO: Found listing with ID: YL27459
2026-03-28 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL27459%27 HTTP/1.1" 200 None
2026-03-28 12:07:43 [auto1.it] INFO: Scrape type for YL27459: 0
2026-03-28 12:07:43 [auto1.it] INFO: Found listing with ID: AG12486
2026-03-28 12:07:43 [auto1.it] INFO: Found listing with ID: VS63609
2026-03-28 12:07:43 [auto1.it] INFO: Found listing with ID: UH61240
2026-03-28 12:07:43 [auto1.it] INFO: Found listing with ID: DM21687
2026-03-28 12:07:43 [auto1.it] INFO: Found listing with ID: ZL42866
2026-03-28 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL42866%27 HTTP/1.1" 200 None
2026-03-28 12:07:43 [auto1.it] INFO: Scrape type for ZL42866: 0
2026-03-28 12:07:43 [auto1.it] INFO: Found listing with ID: YA38395
2026-03-28 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA38395%27 HTTP/1.1" 200 None
2026-03-28 12:07:43 [auto1.it] INFO: Scrape type for YA38395: 0
2026-03-28 12:07:43 [auto1.it] INFO: Found listing with ID: TC50511
2026-03-28 12:07:43 [auto1.it] INFO: Found listing with ID: TK21240
2026-03-28 12:07:43 [auto1.it] INFO: Found listing with ID: VP75887
2026-03-28 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP75887%27 HTTP/1.1" 200 None
2026-03-28 12:07:43 [auto1.it] INFO: Scrape type for VP75887: 0
2026-03-28 12:07:43 [auto1.it] INFO: Found listing with ID: RC55633
2026-03-28 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC55633%27 HTTP/1.1" 200 None
2026-03-28 12:07:43 [auto1.it] INFO: Scrape type for RC55633: 2
2026-03-28 12:07:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85c13a98-c2b0-500a-8483-f136abebc138 with identifier: RC55633
2026-03-28 12:07:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85c13a98-c2b0-500a-8483-f136abebc138 with scrape type 2
2026-03-28 12:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85c13a98-c2b0-500a-8483-f136abebc138 with scrape type 2
2026-03-28 12:07:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 85c13a98-c2b0-500a-8483-f136abebc138, identifier: RC55633
2026-03-28 12:07:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 85c13a98-c2b0-500a-8483-f136abebc138 with identifier: RC55633
2026-03-28 12:07:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 85c13a98-c2b0-500a-8483-f136abebc138 with identifier: RC55633
2026-03-28 12:07:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 85c13a98-c2b0-500a-8483-f136abebc138 with identifier: RC55633 to the API
2026-03-28 12:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:02:43Z',
 'fuel_type': 'diesel',
 'id': '85c13a98-c2b0-500a-8483-f136abebc138',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC55633',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 234307,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-28',
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
 'transmission': 'manual',
 'trim': 'Limited FWD',
 'year': 2015}
2026-03-28 12:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC55633%27 HTTP/1.1" 200 None
2026-03-28 12:07:44 [auto1.it] INFO: Saving data for RC55633: {'auction_closing_time': 1774713763.0, 'created_time': 1774516043.891013, 'last_price_update_time': 1774699664.352339}
2026-03-28 12:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RC55633') HTTP/1.1" 204 0
2026-03-28 12:07:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:44 [auto1.it] INFO: Found listing with ID: DB38288
2026-03-28 12:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB38288%27 HTTP/1.1" 200 None
2026-03-28 12:07:44 [auto1.it] INFO: Scrape type for DB38288: 0
2026-03-28 12:07:44 [auto1.it] INFO: Found listing with ID: ZF04289
2026-03-28 12:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF04289%27 HTTP/1.1" 200 None
2026-03-28 12:07:44 [auto1.it] INFO: Scrape type for ZF04289: 0
2026-03-28 12:07:44 [auto1.it] INFO: Found listing with ID: NP33035
2026-03-28 12:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP33035%27 HTTP/1.1" 200 None
2026-03-28 12:07:44 [auto1.it] INFO: Scrape type for NP33035: 0
2026-03-28 12:07:44 [auto1.it] INFO: Found listing with ID: PA22608
2026-03-28 12:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA22608%27 HTTP/1.1" 200 None
2026-03-28 12:07:44 [auto1.it] INFO: Scrape type for PA22608: 0
2026-03-28 12:07:44 [auto1.it] INFO: Found listing with ID: FH02566
2026-03-28 12:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FH02566%27 HTTP/1.1" 200 None
2026-03-28 12:07:44 [auto1.it] INFO: Scrape type for FH02566: 0
2026-03-28 12:07:44 [auto1.it] INFO: Found listing with ID: XZ64969
2026-03-28 12:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XZ64969%27 HTTP/1.1" 200 None
2026-03-28 12:07:44 [auto1.it] INFO: Scrape type for XZ64969: 0
2026-03-28 12:07:44 [auto1.it] INFO: Found listing with ID: LJ35523
2026-03-28 12:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LJ35523%27 HTTP/1.1" 200 None
2026-03-28 12:07:44 [auto1.it] INFO: Scrape type for LJ35523: 0
2026-03-28 12:07:44 [auto1.it] INFO: Found listing with ID: HH64433
2026-03-28 12:07:44 [auto1.it] INFO: Found listing with ID: GT36426
2026-03-28 12:07:44 [auto1.it] INFO: Found listing with ID: GB77184
2026-03-28 12:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GB77184%27 HTTP/1.1" 200 None
2026-03-28 12:07:44 [auto1.it] INFO: Scrape type for GB77184: 0
2026-03-28 12:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:45 [auto1.it] INFO: Channel: 24h | Page: 22 | totalHits: 3675 | hits on page: 40
2026-03-28 12:07:45 [auto1.it] INFO: Found listing with ID: FC91970
2026-03-28 12:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC91970%27 HTTP/1.1" 200 None
2026-03-28 12:07:45 [auto1.it] INFO: Scrape type for FC91970: 2
2026-03-28 12:07:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17dc6a51-dc8d-52cf-8e6b-3e745770880e with identifier: FC91970
2026-03-28 12:07:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17dc6a51-dc8d-52cf-8e6b-3e745770880e with scrape type 2
2026-03-28 12:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17dc6a51-dc8d-52cf-8e6b-3e745770880e with scrape type 2
2026-03-28 12:07:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 17dc6a51-dc8d-52cf-8e6b-3e745770880e, identifier: FC91970
2026-03-28 12:07:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 17dc6a51-dc8d-52cf-8e6b-3e745770880e with identifier: FC91970
2026-03-28 12:07:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 17dc6a51-dc8d-52cf-8e6b-3e745770880e with identifier: FC91970
2026-03-28 12:07:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 17dc6a51-dc8d-52cf-8e6b-3e745770880e with identifier: FC91970 to the API
2026-03-28 12:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:31:43Z',
 'fuel_type': 'diesel',
 'id': '17dc6a51-dc8d-52cf-8e6b-3e745770880e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC91970',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 161101,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-16',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi Laureate 4x4',
 'transmission': 'manual',
 'trim': 'Laureate 4x4',
 'year': 2014}
2026-03-28 12:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC91970%27 HTTP/1.1" 200 None
2026-03-28 12:07:45 [auto1.it] INFO: Saving data for FC91970: {'auction_closing_time': 1774715503.0, 'created_time': 1774516022.949028, 'last_price_update_time': 1774699665.994019}
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FC91970') HTTP/1.1" 204 0
2026-03-28 12:07:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: RK33520
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK33520%27 HTTP/1.1" 200 None
2026-03-28 12:07:46 [auto1.it] INFO: Scrape type for RK33520: 0
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: RU39980
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: NG82914
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG82914%27 HTTP/1.1" 200 None
2026-03-28 12:07:46 [auto1.it] INFO: Scrape type for NG82914: 0
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: JD30560
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD30560%27 HTTP/1.1" 200 None
2026-03-28 12:07:46 [auto1.it] INFO: Scrape type for JD30560: 0
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: LC51604
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC51604%27 HTTP/1.1" 200 None
2026-03-28 12:07:46 [auto1.it] INFO: Scrape type for LC51604: 0
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: VV63992
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV63992%27 HTTP/1.1" 200 None
2026-03-28 12:07:46 [auto1.it] INFO: Scrape type for VV63992: 0
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: BP08183
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP08183%27 HTTP/1.1" 200 None
2026-03-28 12:07:46 [auto1.it] INFO: Scrape type for BP08183: 2
2026-03-28 12:07:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb9bc249-c4db-5a34-8205-987b9aa0d6bc with identifier: BP08183
2026-03-28 12:07:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb9bc249-c4db-5a34-8205-987b9aa0d6bc with scrape type 2
2026-03-28 12:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb9bc249-c4db-5a34-8205-987b9aa0d6bc with scrape type 2
2026-03-28 12:07:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: eb9bc249-c4db-5a34-8205-987b9aa0d6bc, identifier: BP08183
2026-03-28 12:07:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: eb9bc249-c4db-5a34-8205-987b9aa0d6bc with identifier: BP08183
2026-03-28 12:07:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: eb9bc249-c4db-5a34-8205-987b9aa0d6bc with identifier: BP08183
2026-03-28 12:07:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: eb9bc249-c4db-5a34-8205-987b9aa0d6bc with identifier: BP08183 to the API
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:58:11Z',
 'fuel_type': 'diesel',
 'id': 'eb9bc249-c4db-5a34-8205-987b9aa0d6bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP08183',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 198449,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-28',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Urban',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Urban',
 'year': 2013}
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP08183%27 HTTP/1.1" 200 None
2026-03-28 12:07:46 [auto1.it] INFO: Saving data for BP08183: {'auction_closing_time': 1774717091.0, 'created_time': 1771883968.637491, 'last_price_update_time': 1774699666.69898}
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BP08183') HTTP/1.1" 204 0
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: DZ95846
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: ZT44032
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT44032%27 HTTP/1.1" 200 None
2026-03-28 12:07:46 [auto1.it] INFO: Scrape type for ZT44032: 0
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: UF05417
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: DX27899
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: ZT61879
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT61879%27 HTTP/1.1" 200 None
2026-03-28 12:07:46 [auto1.it] INFO: Scrape type for ZT61879: 0
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: YV19719
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV19719%27 HTTP/1.1" 200 None
2026-03-28 12:07:46 [auto1.it] INFO: Scrape type for YV19719: 0
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: GV78973
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: DK34642
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK34642%27 HTTP/1.1" 200 None
2026-03-28 12:07:46 [auto1.it] INFO: Scrape type for DK34642: 0
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: AB97936
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: UJ97267
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UJ97267%27 HTTP/1.1" 200 None
2026-03-28 12:07:46 [auto1.it] INFO: Scrape type for UJ97267: 0
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: GT90987
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT90987%27 HTTP/1.1" 200 None
2026-03-28 12:07:46 [auto1.it] INFO: Scrape type for GT90987: 0
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: UM32234
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: HT07247
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: AF88379
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: MT61619
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: GS31423
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GS31423%27 HTTP/1.1" 200 None
2026-03-28 12:07:46 [auto1.it] INFO: Scrape type for GS31423: 0
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: EH64041
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH64041%27 HTTP/1.1" 200 None
2026-03-28 12:07:46 [auto1.it] INFO: Scrape type for EH64041: 0
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: FX46616
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX46616%27 HTTP/1.1" 200 None
2026-03-28 12:07:46 [auto1.it] INFO: Scrape type for FX46616: 0
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: PG69305
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PG69305%27 HTTP/1.1" 200 None
2026-03-28 12:07:46 [auto1.it] INFO: Scrape type for PG69305: 0
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: BJ50784
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ50784%27 HTTP/1.1" 200 None
2026-03-28 12:07:46 [auto1.it] INFO: Scrape type for BJ50784: 0
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: CC86207
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC86207%27 HTTP/1.1" 200 None
2026-03-28 12:07:46 [auto1.it] INFO: Scrape type for CC86207: 0
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: YK89440
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: SW20348
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: PZ47386
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: SD88431
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD88431%27 HTTP/1.1" 200 None
2026-03-28 12:07:46 [auto1.it] INFO: Scrape type for SD88431: 0
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: DP81604
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP81604%27 HTTP/1.1" 200 None
2026-03-28 12:07:46 [auto1.it] INFO: Scrape type for DP81604: 0
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: ZU90701
2026-03-28 12:07:46 [auto1.it] INFO: Found listing with ID: LD73585
2026-03-28 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD73585%27 HTTP/1.1" 200 None
2026-03-28 12:07:47 [auto1.it] INFO: Scrape type for LD73585: 0
2026-03-28 12:07:47 [auto1.it] INFO: Found listing with ID: MU03817
2026-03-28 12:07:47 [auto1.it] INFO: Found listing with ID: LP02443
2026-03-28 12:07:47 [auto1.it] INFO: Found listing with ID: FB11512
2026-03-28 12:07:47 [auto1.it] INFO: Found listing with ID: NR94524
2026-03-28 12:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:47 [auto1.it] INFO: Channel: 24h | Page: 23 | totalHits: 3675 | hits on page: 40
2026-03-28 12:07:47 [auto1.it] INFO: Found listing with ID: KB15233
2026-03-28 12:07:47 [auto1.it] INFO: Found listing with ID: AC52318
2026-03-28 12:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AC52318%27 HTTP/1.1" 200 None
2026-03-28 12:07:47 [auto1.it] INFO: Scrape type for AC52318: 0
2026-03-28 12:07:47 [auto1.it] INFO: Found listing with ID: NR89039
2026-03-28 12:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR89039%27 HTTP/1.1" 200 None
2026-03-28 12:07:47 [auto1.it] INFO: Scrape type for NR89039: 0
2026-03-28 12:07:47 [auto1.it] INFO: Found listing with ID: UY23152
2026-03-28 12:07:47 [auto1.it] INFO: Found listing with ID: BC74314
2026-03-28 12:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BC74314%27 HTTP/1.1" 200 None
2026-03-28 12:07:47 [auto1.it] INFO: Scrape type for BC74314: 2
2026-03-28 12:07:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91724b91-0e4e-573b-82de-1bcf808cc753 with identifier: BC74314
2026-03-28 12:07:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91724b91-0e4e-573b-82de-1bcf808cc753 with scrape type 2
2026-03-28 12:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91724b91-0e4e-573b-82de-1bcf808cc753 with scrape type 2
2026-03-28 12:07:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 91724b91-0e4e-573b-82de-1bcf808cc753, identifier: BC74314
2026-03-28 12:07:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 91724b91-0e4e-573b-82de-1bcf808cc753 with identifier: BC74314
2026-03-28 12:07:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 91724b91-0e4e-573b-82de-1bcf808cc753 with identifier: BC74314
2026-03-28 12:07:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 91724b91-0e4e-573b-82de-1bcf808cc753 with identifier: BC74314 to the API
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:49:10Z',
 'fuel_type': 'diesel',
 'id': '91724b91-0e4e-573b-82de-1bcf808cc753',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC74314',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 230583,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-30',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 Ocean Race 2WD',
 'transmission': 'automatic',
 'trim': 'Ocean Race 2WD',
 'year': 2016}
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BC74314%27 HTTP/1.1" 200 None
2026-03-28 12:07:48 [auto1.it] INFO: Saving data for BC74314: {'auction_closing_time': 1774716550.0, 'created_time': 1774515959.38709, 'last_price_update_time': 1774699668.414467}
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BC74314') HTTP/1.1" 204 0
2026-03-28 12:07:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: HU90356
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: AU61443
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU61443%27 HTTP/1.1" 200 None
2026-03-28 12:07:48 [auto1.it] INFO: Scrape type for AU61443: 0
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: LS03457
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS03457%27 HTTP/1.1" 200 None
2026-03-28 12:07:48 [auto1.it] INFO: Scrape type for LS03457: 0
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: SU12582
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: CH03473
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH03473%27 HTTP/1.1" 200 None
2026-03-28 12:07:48 [auto1.it] INFO: Scrape type for CH03473: 0
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: BF84159
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF84159%27 HTTP/1.1" 200 None
2026-03-28 12:07:48 [auto1.it] INFO: Scrape type for BF84159: 0
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: PE07911
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: LP76273
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LP76273%27 HTTP/1.1" 200 None
2026-03-28 12:07:48 [auto1.it] INFO: Scrape type for LP76273: 0
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: WD39478
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: AB43384
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: CS05902
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS05902%27 HTTP/1.1" 200 None
2026-03-28 12:07:48 [auto1.it] INFO: Scrape type for CS05902: 0
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: LY95127
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY95127%27 HTTP/1.1" 200 None
2026-03-28 12:07:48 [auto1.it] INFO: Scrape type for LY95127: 0
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: NN95348
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: RR71637
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR71637%27 HTTP/1.1" 200 None
2026-03-28 12:07:48 [auto1.it] INFO: Scrape type for RR71637: 0
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: YT62048
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT62048%27 HTTP/1.1" 200 None
2026-03-28 12:07:48 [auto1.it] INFO: Scrape type for YT62048: 0
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: HN00760
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HN00760%27 HTTP/1.1" 200 None
2026-03-28 12:07:48 [auto1.it] INFO: Scrape type for HN00760: 0
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: TA79833
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: VH62552
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: JV70876
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV70876%27 HTTP/1.1" 200 None
2026-03-28 12:07:48 [auto1.it] INFO: Scrape type for JV70876: 0
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: NY67397
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: GG13380
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: EF94220
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: SP82579
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: LJ38222
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: EZ15489
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: HY22945
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY22945%27 HTTP/1.1" 200 None
2026-03-28 12:07:48 [auto1.it] INFO: Scrape type for HY22945: 0
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: PY49742
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY49742%27 HTTP/1.1" 200 None
2026-03-28 12:07:48 [auto1.it] INFO: Scrape type for PY49742: 0
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: VX37353
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: ZP51405
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: EG41470
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG41470%27 HTTP/1.1" 200 None
2026-03-28 12:07:48 [auto1.it] INFO: Scrape type for EG41470: 0
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: UD85899
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: JZ67202
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: ZM49441
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: VV14244
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV14244%27 HTTP/1.1" 200 None
2026-03-28 12:07:48 [auto1.it] INFO: Scrape type for VV14244: 0
2026-03-28 12:07:48 [auto1.it] INFO: Found listing with ID: JR03876
2026-03-28 12:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:49 [auto1.it] INFO: Channel: 24h | Page: 24 | totalHits: 3675 | hits on page: 40
2026-03-28 12:07:49 [auto1.it] INFO: Found listing with ID: VH71925
2026-03-28 12:07:49 [auto1.it] INFO: Found listing with ID: TE89149
2026-03-28 12:07:49 [auto1.it] INFO: Found listing with ID: CC36566
2026-03-28 12:07:49 [auto1.it] INFO: Found listing with ID: RT91263
2026-03-28 12:07:49 [auto1.it] INFO: Found listing with ID: VP99832
2026-03-28 12:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP99832%27 HTTP/1.1" 200 None
2026-03-28 12:07:49 [auto1.it] INFO: Scrape type for VP99832: 0
2026-03-28 12:07:49 [auto1.it] INFO: Found listing with ID: DS58810
2026-03-28 12:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS58810%27 HTTP/1.1" 200 None
2026-03-28 12:07:49 [auto1.it] INFO: Scrape type for DS58810: 0
2026-03-28 12:07:49 [auto1.it] INFO: Found listing with ID: JT10117
2026-03-28 12:07:49 [auto1.it] INFO: Found listing with ID: HS83274
2026-03-28 12:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS83274%27 HTTP/1.1" 200 None
2026-03-28 12:07:49 [auto1.it] INFO: Scrape type for HS83274: 2
2026-03-28 12:07:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0c832a0-f3c6-58f0-932f-bd15cd097483 with identifier: HS83274
2026-03-28 12:07:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0c832a0-f3c6-58f0-932f-bd15cd097483 with scrape type 2
2026-03-28 12:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0c832a0-f3c6-58f0-932f-bd15cd097483 with scrape type 2
2026-03-28 12:07:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d0c832a0-f3c6-58f0-932f-bd15cd097483, identifier: HS83274
2026-03-28 12:07:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d0c832a0-f3c6-58f0-932f-bd15cd097483 with identifier: HS83274
2026-03-28 12:07:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d0c832a0-f3c6-58f0-932f-bd15cd097483 with identifier: HS83274
2026-03-28 12:07:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d0c832a0-f3c6-58f0-932f-bd15cd097483 with identifier: HS83274 to the API
2026-03-28 12:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:54:35Z',
 'fuel_type': 'diesel',
 'id': 'd0c832a0-f3c6-58f0-932f-bd15cd097483',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS83274',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 134422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-19',
 'seller_name': None,
 'title': 'Fiat 500X 1.3 M-Jet Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2016}
2026-03-28 12:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS83274%27 HTTP/1.1" 200 None
2026-03-28 12:07:50 [auto1.it] INFO: Saving data for HS83274: {'auction_closing_time': 1774716875.0, 'created_time': 1774516049.207153, 'last_price_update_time': 1774699670.123861}
2026-03-28 12:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HS83274') HTTP/1.1" 204 0
2026-03-28 12:07:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:50 [auto1.it] INFO: Found listing with ID: LA76603
2026-03-28 12:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA76603%27 HTTP/1.1" 200 None
2026-03-28 12:07:50 [auto1.it] INFO: Scrape type for LA76603: 0
2026-03-28 12:07:50 [auto1.it] INFO: Found listing with ID: CC08861
2026-03-28 12:07:50 [auto1.it] INFO: Found listing with ID: XN65989
2026-03-28 12:07:50 [auto1.it] INFO: Found listing with ID: UP48367
2026-03-28 12:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UP48367%27 HTTP/1.1" 200 None
2026-03-28 12:07:50 [auto1.it] INFO: Scrape type for UP48367: 0
2026-03-28 12:07:50 [auto1.it] INFO: Found listing with ID: HD54235
2026-03-28 12:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD54235%27 HTTP/1.1" 200 None
2026-03-28 12:07:50 [auto1.it] INFO: Scrape type for HD54235: 0
2026-03-28 12:07:50 [auto1.it] INFO: Found listing with ID: HS60587
2026-03-28 12:07:50 [auto1.it] INFO: Found listing with ID: TX80961
2026-03-28 12:07:50 [auto1.it] INFO: Found listing with ID: BP45354
2026-03-28 12:07:50 [auto1.it] INFO: Found listing with ID: SS67586
2026-03-28 12:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS67586%27 HTTP/1.1" 200 None
2026-03-28 12:07:50 [auto1.it] INFO: Scrape type for SS67586: 2
2026-03-28 12:07:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2823c0b-3913-5e0b-a2c6-d2b8e4e71d31 with identifier: SS67586
2026-03-28 12:07:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2823c0b-3913-5e0b-a2c6-d2b8e4e71d31 with scrape type 2
2026-03-28 12:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2823c0b-3913-5e0b-a2c6-d2b8e4e71d31 with scrape type 2
2026-03-28 12:07:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a2823c0b-3913-5e0b-a2c6-d2b8e4e71d31, identifier: SS67586
2026-03-28 12:07:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a2823c0b-3913-5e0b-a2c6-d2b8e4e71d31 with identifier: SS67586
2026-03-28 12:07:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a2823c0b-3913-5e0b-a2c6-d2b8e4e71d31 with identifier: SS67586
2026-03-28 12:07:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a2823c0b-3913-5e0b-a2c6-d2b8e4e71d31 with identifier: SS67586 to the API
2026-03-28 12:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:00:08Z',
 'fuel_type': 'diesel',
 'id': 'a2823c0b-3913-5e0b-a2c6-d2b8e4e71d31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS67586',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 334759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-11',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI T BlueEfficiency Avantgarde',
 'transmission': 'manual',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2013}
2026-03-28 12:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS67586%27 HTTP/1.1" 200 None
2026-03-28 12:07:50 [auto1.it] INFO: Saving data for SS67586: {'auction_closing_time': 1774713608.0, 'created_time': 1772624140.547314, 'last_price_update_time': 1774699670.680111}
2026-03-28 12:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SS67586') HTTP/1.1" 204 0
2026-03-28 12:07:50 [auto1.it] INFO: Found listing with ID: ZW77638
2026-03-28 12:07:50 [auto1.it] INFO: Found listing with ID: DS11019
2026-03-28 12:07:50 [auto1.it] INFO: Found listing with ID: MT42798
2026-03-28 12:07:50 [auto1.it] INFO: Found listing with ID: AY21125
2026-03-28 12:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY21125%27 HTTP/1.1" 200 None
2026-03-28 12:07:50 [auto1.it] INFO: Scrape type for AY21125: 0
2026-03-28 12:07:50 [auto1.it] INFO: Found listing with ID: XF71251
2026-03-28 12:07:50 [auto1.it] INFO: Found listing with ID: YG03340
2026-03-28 12:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG03340%27 HTTP/1.1" 200 None
2026-03-28 12:07:50 [auto1.it] INFO: Scrape type for YG03340: 0
2026-03-28 12:07:50 [auto1.it] INFO: Found listing with ID: HV87754
2026-03-28 12:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HV87754%27 HTTP/1.1" 200 None
2026-03-28 12:07:50 [auto1.it] INFO: Scrape type for HV87754: 0
2026-03-28 12:07:50 [auto1.it] INFO: Found listing with ID: UE23071
2026-03-28 12:07:50 [auto1.it] INFO: Found listing with ID: SP98700
2026-03-28 12:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP98700%27 HTTP/1.1" 200 None
2026-03-28 12:07:50 [auto1.it] INFO: Scrape type for SP98700: 0
2026-03-28 12:07:50 [auto1.it] INFO: Found listing with ID: CH78028
2026-03-28 12:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH78028%27 HTTP/1.1" 200 None
2026-03-28 12:07:50 [auto1.it] INFO: Scrape type for CH78028: 0
2026-03-28 12:07:50 [auto1.it] INFO: Found listing with ID: RS56443
2026-03-28 12:07:50 [auto1.it] INFO: Found listing with ID: VZ89804
2026-03-28 12:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VZ89804%27 HTTP/1.1" 200 None
2026-03-28 12:07:50 [auto1.it] INFO: Scrape type for VZ89804: 2
2026-03-28 12:07:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef9810b3-821c-5772-9177-eb877ad871ed with identifier: VZ89804
2026-03-28 12:07:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef9810b3-821c-5772-9177-eb877ad871ed with scrape type 2
2026-03-28 12:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef9810b3-821c-5772-9177-eb877ad871ed with scrape type 2
2026-03-28 12:07:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ef9810b3-821c-5772-9177-eb877ad871ed, identifier: VZ89804
2026-03-28 12:07:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ef9810b3-821c-5772-9177-eb877ad871ed with identifier: VZ89804
2026-03-28 12:07:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ef9810b3-821c-5772-9177-eb877ad871ed with identifier: VZ89804
2026-03-28 12:07:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ef9810b3-821c-5772-9177-eb877ad871ed with identifier: VZ89804 to the API
2026-03-28 12:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:28:15Z',
 'fuel_type': 'diesel',
 'id': 'ef9810b3-821c-5772-9177-eb877ad871ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ89804',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 237007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-03',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2019}
2026-03-28 12:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VZ89804%27 HTTP/1.1" 200 None
2026-03-28 12:07:51 [auto1.it] INFO: Saving data for VZ89804: {'auction_closing_time': 1774715295.0, 'created_time': 1771876979.930409, 'last_price_update_time': 1774699671.236204}
2026-03-28 12:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VZ89804') HTTP/1.1" 204 0
2026-03-28 12:07:51 [auto1.it] INFO: Found listing with ID: FP61129
2026-03-28 12:07:51 [auto1.it] INFO: Found listing with ID: AT32399
2026-03-28 12:07:51 [auto1.it] INFO: Found listing with ID: LC14849
2026-03-28 12:07:51 [auto1.it] INFO: Found listing with ID: WJ96008
2026-03-28 12:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WJ96008%27 HTTP/1.1" 200 None
2026-03-28 12:07:51 [auto1.it] INFO: Scrape type for WJ96008: 0
2026-03-28 12:07:51 [auto1.it] INFO: Found listing with ID: AF81201
2026-03-28 12:07:51 [auto1.it] INFO: Found listing with ID: RR40401
2026-03-28 12:07:51 [auto1.it] INFO: Found listing with ID: TA22060
2026-03-28 12:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TA22060%27 HTTP/1.1" 200 None
2026-03-28 12:07:51 [auto1.it] INFO: Scrape type for TA22060: 0
2026-03-28 12:07:51 [auto1.it] INFO: Found listing with ID: ZW69892
2026-03-28 12:07:51 [auto1.it] INFO: Found listing with ID: VS11522
2026-03-28 12:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS11522%27 HTTP/1.1" 200 None
2026-03-28 12:07:51 [auto1.it] INFO: Scrape type for VS11522: 0
2026-03-28 12:07:51 [auto1.it] INFO: Found listing with ID: NU78956
2026-03-28 12:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NU78956%27 HTTP/1.1" 200 None
2026-03-28 12:07:51 [auto1.it] INFO: Scrape type for NU78956: 0
2026-03-28 12:07:51 [auto1.it] INFO: Found listing with ID: PT72554
2026-03-28 12:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT72554%27 HTTP/1.1" 200 None
2026-03-28 12:07:51 [auto1.it] INFO: Scrape type for PT72554: 0
2026-03-28 12:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:52 [auto1.it] INFO: Channel: 24h | Page: 25 | totalHits: 3675 | hits on page: 40
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: BV97691
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: CF78450
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: FU36199
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: AD96495
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: DJ66527
2026-03-28 12:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ66527%27 HTTP/1.1" 200 None
2026-03-28 12:07:52 [auto1.it] INFO: Scrape type for DJ66527: 0
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: EC51019
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: CH88707
2026-03-28 12:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH88707%27 HTTP/1.1" 200 None
2026-03-28 12:07:52 [auto1.it] INFO: Scrape type for CH88707: 0
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: LY98983
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: YP32890
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: WL70343
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: JD09994
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: AA32249
2026-03-28 12:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AA32249%27 HTTP/1.1" 200 None
2026-03-28 12:07:52 [auto1.it] INFO: Scrape type for AA32249: 0
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: AX60042
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: NN95862
2026-03-28 12:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NN95862%27 HTTP/1.1" 200 None
2026-03-28 12:07:52 [auto1.it] INFO: Scrape type for NN95862: 0
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: MH62974
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: VS31933
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: KH50025
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: KZ03059
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: BA03672
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: DY31540
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: WG30264
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: LH23447
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: DB60512
2026-03-28 12:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB60512%27 HTTP/1.1" 200 None
2026-03-28 12:07:52 [auto1.it] INFO: Scrape type for DB60512: 0
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: ER97620
2026-03-28 12:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ER97620%27 HTTP/1.1" 200 None
2026-03-28 12:07:52 [auto1.it] INFO: Scrape type for ER97620: 0
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: LW22359
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: RA17642
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: XA69003
2026-03-28 12:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XA69003%27 HTTP/1.1" 200 None
2026-03-28 12:07:52 [auto1.it] INFO: Scrape type for XA69003: 0
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: FA25945
2026-03-28 12:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA25945%27 HTTP/1.1" 200 None
2026-03-28 12:07:52 [auto1.it] INFO: Scrape type for FA25945: 0
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: XH39362
2026-03-28 12:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH39362%27 HTTP/1.1" 200 None
2026-03-28 12:07:52 [auto1.it] INFO: Scrape type for XH39362: 0
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: EE84208
2026-03-28 12:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE84208%27 HTTP/1.1" 200 None
2026-03-28 12:07:52 [auto1.it] INFO: Scrape type for EE84208: 0
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: AM77280
2026-03-28 12:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AM77280%27 HTTP/1.1" 200 None
2026-03-28 12:07:52 [auto1.it] INFO: Scrape type for AM77280: 0
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: VH07550
2026-03-28 12:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH07550%27 HTTP/1.1" 200 None
2026-03-28 12:07:52 [auto1.it] INFO: Scrape type for VH07550: 0
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: DW53696
2026-03-28 12:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW53696%27 HTTP/1.1" 200 None
2026-03-28 12:07:52 [auto1.it] INFO: Scrape type for DW53696: 0
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: HA02667
2026-03-28 12:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA02667%27 HTTP/1.1" 200 None
2026-03-28 12:07:52 [auto1.it] INFO: Scrape type for HA02667: 0
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: VF37743
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: YF99217
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: DY73296
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: EG78333
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: PY58212
2026-03-28 12:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY58212%27 HTTP/1.1" 200 None
2026-03-28 12:07:52 [auto1.it] INFO: Scrape type for PY58212: 0
2026-03-28 12:07:52 [auto1.it] INFO: Found listing with ID: RZ99853
2026-03-28 12:07:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:53 [auto1.it] INFO: Channel: 24h | Page: 26 | totalHits: 3675 | hits on page: 40
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: RL06920
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: GK45626
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GK45626%27 HTTP/1.1" 200 None
2026-03-28 12:07:53 [auto1.it] INFO: Scrape type for GK45626: 0
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: TY80704
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY80704%27 HTTP/1.1" 200 None
2026-03-28 12:07:53 [auto1.it] INFO: Scrape type for TY80704: 0
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: TU01190
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: LW64667
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: AG51649
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG51649%27 HTTP/1.1" 200 None
2026-03-28 12:07:53 [auto1.it] INFO: Scrape type for AG51649: 0
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: HY24657
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: BA90157
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: AZ56413
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ56413%27 HTTP/1.1" 200 None
2026-03-28 12:07:53 [auto1.it] INFO: Scrape type for AZ56413: 0
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: EV65529
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV65529%27 HTTP/1.1" 200 None
2026-03-28 12:07:53 [auto1.it] INFO: Scrape type for EV65529: 0
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: HK54342
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: TD67992
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: BD83162
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD83162%27 HTTP/1.1" 200 None
2026-03-28 12:07:53 [auto1.it] INFO: Scrape type for BD83162: 0
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: WZ30101
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WZ30101%27 HTTP/1.1" 200 None
2026-03-28 12:07:53 [auto1.it] INFO: Scrape type for WZ30101: 0
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: FP75199
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP75199%27 HTTP/1.1" 200 None
2026-03-28 12:07:53 [auto1.it] INFO: Scrape type for FP75199: 0
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: KX92942
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KX92942%27 HTTP/1.1" 200 None
2026-03-28 12:07:53 [auto1.it] INFO: Scrape type for KX92942: 0
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: HC85966
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC85966%27 HTTP/1.1" 200 None
2026-03-28 12:07:53 [auto1.it] INFO: Scrape type for HC85966: 0
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: RC69852
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: NB44357
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: NV42271
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV42271%27 HTTP/1.1" 200 None
2026-03-28 12:07:53 [auto1.it] INFO: Scrape type for NV42271: 0
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: CS16004
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS16004%27 HTTP/1.1" 200 None
2026-03-28 12:07:53 [auto1.it] INFO: Scrape type for CS16004: 0
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: YA80598
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA80598%27 HTTP/1.1" 200 None
2026-03-28 12:07:53 [auto1.it] INFO: Scrape type for YA80598: 0
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: EX06021
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: MS41612
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: RN15914
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN15914%27 HTTP/1.1" 200 None
2026-03-28 12:07:53 [auto1.it] INFO: Scrape type for RN15914: 0
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: TP79080
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: WE89582
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WE89582%27 HTTP/1.1" 200 None
2026-03-28 12:07:53 [auto1.it] INFO: Scrape type for WE89582: 0
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: EF87195
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: WE25816
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WE25816%27 HTTP/1.1" 200 None
2026-03-28 12:07:53 [auto1.it] INFO: Scrape type for WE25816: 0
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: BH62739
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: HE61861
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE61861%27 HTTP/1.1" 200 None
2026-03-28 12:07:53 [auto1.it] INFO: Scrape type for HE61861: 0
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: ZP49610
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: JF46642
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF46642%27 HTTP/1.1" 200 None
2026-03-28 12:07:53 [auto1.it] INFO: Scrape type for JF46642: 0
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: PD12623
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD12623%27 HTTP/1.1" 200 None
2026-03-28 12:07:53 [auto1.it] INFO: Scrape type for PD12623: 0
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: KZ30481
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ30481%27 HTTP/1.1" 200 None
2026-03-28 12:07:53 [auto1.it] INFO: Scrape type for KZ30481: 0
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: XG03695
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: ZM05911
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: SK71918
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: RY16068
2026-03-28 12:07:53 [auto1.it] INFO: Found listing with ID: ZL28386
2026-03-28 12:07:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:54 [auto1.it] INFO: Channel: 24h | Page: 27 | totalHits: 3675 | hits on page: 40
2026-03-28 12:07:54 [auto1.it] INFO: Found listing with ID: HA95428
2026-03-28 12:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA95428%27 HTTP/1.1" 200 None
2026-03-28 12:07:54 [auto1.it] INFO: Scrape type for HA95428: 0
2026-03-28 12:07:54 [auto1.it] INFO: Found listing with ID: YV30830
2026-03-28 12:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV30830%27 HTTP/1.1" 200 None
2026-03-28 12:07:54 [auto1.it] INFO: Scrape type for YV30830: 0
2026-03-28 12:07:54 [auto1.it] INFO: Found listing with ID: GW68034
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW68034%27 HTTP/1.1" 200 None
2026-03-28 12:07:55 [auto1.it] INFO: Scrape type for GW68034: 0
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: CC46702
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: GY41303
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: JN64307
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN64307%27 HTTP/1.1" 200 None
2026-03-28 12:07:55 [auto1.it] INFO: Scrape type for JN64307: 0
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: DT10688
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT10688%27 HTTP/1.1" 200 None
2026-03-28 12:07:55 [auto1.it] INFO: Scrape type for DT10688: 0
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: KW88913
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW88913%27 HTTP/1.1" 200 None
2026-03-28 12:07:55 [auto1.it] INFO: Scrape type for KW88913: 0
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: WR05757
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR05757%27 HTTP/1.1" 200 None
2026-03-28 12:07:55 [auto1.it] INFO: Scrape type for WR05757: 0
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: KN14536
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KN14536%27 HTTP/1.1" 200 None
2026-03-28 12:07:55 [auto1.it] INFO: Scrape type for KN14536: 0
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: GR13537
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: PU36388
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PU36388%27 HTTP/1.1" 200 None
2026-03-28 12:07:55 [auto1.it] INFO: Scrape type for PU36388: 0
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: CJ46241
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CJ46241%27 HTTP/1.1" 200 None
2026-03-28 12:07:55 [auto1.it] INFO: Scrape type for CJ46241: 0
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: DF43050
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: PN79982
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: VS33073
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: GR09815
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR09815%27 HTTP/1.1" 200 None
2026-03-28 12:07:55 [auto1.it] INFO: Scrape type for GR09815: 0
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: RG52060
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG52060%27 HTTP/1.1" 200 None
2026-03-28 12:07:55 [auto1.it] INFO: Scrape type for RG52060: 0
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: SJ09087
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: CV33669
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV33669%27 HTTP/1.1" 200 None
2026-03-28 12:07:55 [auto1.it] INFO: Scrape type for CV33669: 0
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: UB96617
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: CC54288
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: SR46685
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: ZK89803
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: BX02357
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX02357%27 HTTP/1.1" 200 None
2026-03-28 12:07:55 [auto1.it] INFO: Scrape type for BX02357: 0
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: GH50385
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: JK53283
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK53283%27 HTTP/1.1" 200 None
2026-03-28 12:07:55 [auto1.it] INFO: Scrape type for JK53283: 0
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: JF95895
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF95895%27 HTTP/1.1" 200 None
2026-03-28 12:07:55 [auto1.it] INFO: Scrape type for JF95895: 0
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: NT74531
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: TS34792
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: CS89848
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: UY09098
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: CP19767
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: KR43222
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: SU00968
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SU00968%27 HTTP/1.1" 200 None
2026-03-28 12:07:55 [auto1.it] INFO: Scrape type for SU00968: 0
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: NT59940
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: JA46265
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA46265%27 HTTP/1.1" 200 None
2026-03-28 12:07:55 [auto1.it] INFO: Scrape type for JA46265: 0
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: RR88002
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR88002%27 HTTP/1.1" 200 None
2026-03-28 12:07:55 [auto1.it] INFO: Scrape type for RR88002: 0
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: KJ52341
2026-03-28 12:07:55 [auto1.it] INFO: Found listing with ID: ZS89496
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS89496%27 HTTP/1.1" 200 None
2026-03-28 12:07:55 [auto1.it] INFO: Scrape type for ZS89496: 0
2026-03-28 12:07:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:56 [auto1.it] INFO: Channel: 24h | Page: 28 | totalHits: 3675 | hits on page: 40
2026-03-28 12:07:56 [auto1.it] INFO: Found listing with ID: LF91623
2026-03-28 12:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LF91623%27 HTTP/1.1" 200 None
2026-03-28 12:07:56 [auto1.it] INFO: Scrape type for LF91623: 0
2026-03-28 12:07:56 [auto1.it] INFO: Found listing with ID: EB44721
2026-03-28 12:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EB44721%27 HTTP/1.1" 200 None
2026-03-28 12:07:56 [auto1.it] INFO: Scrape type for EB44721: 0
2026-03-28 12:07:56 [auto1.it] INFO: Found listing with ID: TZ05140
2026-03-28 12:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ05140%27 HTTP/1.1" 200 None
2026-03-28 12:07:56 [auto1.it] INFO: Scrape type for TZ05140: 0
2026-03-28 12:07:56 [auto1.it] INFO: Found listing with ID: NG93941
2026-03-28 12:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG93941%27 HTTP/1.1" 200 None
2026-03-28 12:07:56 [auto1.it] INFO: Scrape type for NG93941: 0
2026-03-28 12:07:56 [auto1.it] INFO: Found listing with ID: NL26741
2026-03-28 12:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL26741%27 HTTP/1.1" 200 None
2026-03-28 12:07:56 [auto1.it] INFO: Scrape type for NL26741: 0
2026-03-28 12:07:56 [auto1.it] INFO: Found listing with ID: BF95758
2026-03-28 12:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF95758%27 HTTP/1.1" 200 None
2026-03-28 12:07:56 [auto1.it] INFO: Scrape type for BF95758: 0
2026-03-28 12:07:56 [auto1.it] INFO: Found listing with ID: LG12773
2026-03-28 12:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG12773%27 HTTP/1.1" 200 None
2026-03-28 12:07:56 [auto1.it] INFO: Scrape type for LG12773: 0
2026-03-28 12:07:56 [auto1.it] INFO: Found listing with ID: SK24078
2026-03-28 12:07:56 [auto1.it] INFO: Found listing with ID: AN86148
2026-03-28 12:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN86148%27 HTTP/1.1" 200 None
2026-03-28 12:07:56 [auto1.it] INFO: Scrape type for AN86148: 0
2026-03-28 12:07:56 [auto1.it] INFO: Found listing with ID: EM78419
2026-03-28 12:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EM78419%27 HTTP/1.1" 200 None
2026-03-28 12:07:56 [auto1.it] INFO: Scrape type for EM78419: 0
2026-03-28 12:07:56 [auto1.it] INFO: Found listing with ID: TT32643
2026-03-28 12:07:56 [auto1.it] INFO: Found listing with ID: GD67829
2026-03-28 12:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD67829%27 HTTP/1.1" 200 None
2026-03-28 12:07:56 [auto1.it] INFO: Scrape type for GD67829: 2
2026-03-28 12:07:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8ae551f-f78a-5813-a1ad-1cbca637342f with identifier: GD67829
2026-03-28 12:07:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8ae551f-f78a-5813-a1ad-1cbca637342f with scrape type 2
2026-03-28 12:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8ae551f-f78a-5813-a1ad-1cbca637342f with scrape type 2
2026-03-28 12:07:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f8ae551f-f78a-5813-a1ad-1cbca637342f, identifier: GD67829
2026-03-28 12:07:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f8ae551f-f78a-5813-a1ad-1cbca637342f with identifier: GD67829
2026-03-28 12:07:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f8ae551f-f78a-5813-a1ad-1cbca637342f with identifier: GD67829
2026-03-28 12:07:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f8ae551f-f78a-5813-a1ad-1cbca637342f with identifier: GD67829 to the API
2026-03-28 12:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:45:44Z',
 'fuel_type': 'petrol',
 'id': 'f8ae551f-f78a-5813-a1ad-1cbca637342f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD67829',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 122233,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-09-11',
 'seller_name': None,
 'title': 'Audi A6 1.8 Turbo',
 'transmission': 'manual',
 'trim': '',
 'year': 2000}
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD67829%27 HTTP/1.1" 200 None
2026-03-28 12:07:57 [auto1.it] INFO: Saving data for GD67829: {'auction_closing_time': 1774716344.0, 'created_time': 1774386521.466383, 'last_price_update_time': 1774699677.156635}
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GD67829') HTTP/1.1" 204 0
2026-03-28 12:07:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:07:57 [auto1.it] INFO: Found listing with ID: RA70814
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA70814%27 HTTP/1.1" 200 None
2026-03-28 12:07:57 [auto1.it] INFO: Scrape type for RA70814: 2
2026-03-28 12:07:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 876f0b84-e1ec-5fc2-85c9-77a6fada2ddd with identifier: RA70814
2026-03-28 12:07:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 876f0b84-e1ec-5fc2-85c9-77a6fada2ddd with scrape type 2
2026-03-28 12:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 876f0b84-e1ec-5fc2-85c9-77a6fada2ddd with scrape type 2
2026-03-28 12:07:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 876f0b84-e1ec-5fc2-85c9-77a6fada2ddd, identifier: RA70814
2026-03-28 12:07:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 876f0b84-e1ec-5fc2-85c9-77a6fada2ddd with identifier: RA70814
2026-03-28 12:07:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 876f0b84-e1ec-5fc2-85c9-77a6fada2ddd with identifier: RA70814
2026-03-28 12:07:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 876f0b84-e1ec-5fc2-85c9-77a6fada2ddd with identifier: RA70814 to the API
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:57:02Z',
 'fuel_type': 'diesel',
 'id': '876f0b84-e1ec-5fc2-85c9-77a6fada2ddd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA70814',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 145070,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-26',
 'seller_name': None,
 'title': 'Fiat Punto 1.3 JTD DPF Street',
 'transmission': 'manual',
 'trim': 'Street',
 'year': 2014}
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA70814%27 HTTP/1.1" 200 None
2026-03-28 12:07:57 [auto1.it] INFO: Saving data for RA70814: {'auction_closing_time': 1774717022.0, 'created_time': 1772178109.98946, 'last_price_update_time': 1774699677.712578}
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RA70814') HTTP/1.1" 204 0
2026-03-28 12:07:57 [auto1.it] INFO: Found listing with ID: BX38119
2026-03-28 12:07:57 [auto1.it] INFO: Found listing with ID: FR55609
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR55609%27 HTTP/1.1" 200 None
2026-03-28 12:07:57 [auto1.it] INFO: Scrape type for FR55609: 0
2026-03-28 12:07:57 [auto1.it] INFO: Found listing with ID: ZW61080
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW61080%27 HTTP/1.1" 200 None
2026-03-28 12:07:57 [auto1.it] INFO: Scrape type for ZW61080: 0
2026-03-28 12:07:57 [auto1.it] INFO: Found listing with ID: ZN01061
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN01061%27 HTTP/1.1" 200 None
2026-03-28 12:07:57 [auto1.it] INFO: Scrape type for ZN01061: 0
2026-03-28 12:07:57 [auto1.it] INFO: Found listing with ID: CB66149
2026-03-28 12:07:57 [auto1.it] INFO: Found listing with ID: PY10905
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY10905%27 HTTP/1.1" 200 None
2026-03-28 12:07:57 [auto1.it] INFO: Scrape type for PY10905: 0
2026-03-28 12:07:57 [auto1.it] INFO: Found listing with ID: AR54345
2026-03-28 12:07:57 [auto1.it] INFO: Found listing with ID: HH71659
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH71659%27 HTTP/1.1" 200 None
2026-03-28 12:07:57 [auto1.it] INFO: Scrape type for HH71659: 0
2026-03-28 12:07:57 [auto1.it] INFO: Found listing with ID: YL77107
2026-03-28 12:07:57 [auto1.it] INFO: Found listing with ID: NZ65760
2026-03-28 12:07:57 [auto1.it] INFO: Found listing with ID: EZ92268
2026-03-28 12:07:57 [auto1.it] INFO: Found listing with ID: SS19742
2026-03-28 12:07:57 [auto1.it] INFO: Found listing with ID: UA22723
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA22723%27 HTTP/1.1" 200 None
2026-03-28 12:07:57 [auto1.it] INFO: Scrape type for UA22723: 0
2026-03-28 12:07:57 [auto1.it] INFO: Found listing with ID: WN10249
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN10249%27 HTTP/1.1" 200 None
2026-03-28 12:07:57 [auto1.it] INFO: Scrape type for WN10249: 0
2026-03-28 12:07:57 [auto1.it] INFO: Found listing with ID: BS22593
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BS22593%27 HTTP/1.1" 200 None
2026-03-28 12:07:57 [auto1.it] INFO: Scrape type for BS22593: 0
2026-03-28 12:07:57 [auto1.it] INFO: Found listing with ID: RS53925
2026-03-28 12:07:57 [auto1.it] INFO: Found listing with ID: WF98355
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WF98355%27 HTTP/1.1" 200 None
2026-03-28 12:07:57 [auto1.it] INFO: Scrape type for WF98355: 0
2026-03-28 12:07:57 [auto1.it] INFO: Found listing with ID: KK16501
2026-03-28 12:07:57 [auto1.it] INFO: Found listing with ID: AL46410
2026-03-28 12:07:57 [auto1.it] INFO: Found listing with ID: EY73607
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY73607%27 HTTP/1.1" 200 None
2026-03-28 12:07:57 [auto1.it] INFO: Scrape type for EY73607: 0
2026-03-28 12:07:57 [auto1.it] INFO: Found listing with ID: NR08149
2026-03-28 12:07:57 [auto1.it] INFO: Found listing with ID: BR68512
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR68512%27 HTTP/1.1" 200 None
2026-03-28 12:07:57 [auto1.it] INFO: Scrape type for BR68512: 0
2026-03-28 12:07:57 [auto1.it] INFO: Found listing with ID: ED61814
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED61814%27 HTTP/1.1" 200 None
2026-03-28 12:07:57 [auto1.it] INFO: Scrape type for ED61814: 2
2026-03-28 12:07:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a71846f-3c23-5e6a-bbd4-9ffee4d75405 with identifier: ED61814
2026-03-28 12:07:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a71846f-3c23-5e6a-bbd4-9ffee4d75405 with scrape type 2
2026-03-28 12:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a71846f-3c23-5e6a-bbd4-9ffee4d75405 with scrape type 2
2026-03-28 12:07:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5a71846f-3c23-5e6a-bbd4-9ffee4d75405, identifier: ED61814
2026-03-28 12:07:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5a71846f-3c23-5e6a-bbd4-9ffee4d75405 with identifier: ED61814
2026-03-28 12:07:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5a71846f-3c23-5e6a-bbd4-9ffee4d75405 with identifier: ED61814
2026-03-28 12:07:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5a71846f-3c23-5e6a-bbd4-9ffee4d75405 with identifier: ED61814 to the API
2026-03-28 12:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:53:37Z',
 'fuel_type': 'diesel',
 'id': '5a71846f-3c23-5e6a-bbd4-9ffee4d75405',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED61814',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 171584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-09',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2015}
2026-03-28 12:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED61814%27 HTTP/1.1" 200 None
2026-03-28 12:07:58 [auto1.it] INFO: Saving data for ED61814: {'auction_closing_time': 1774716817.0, 'created_time': 1774516054.643117, 'last_price_update_time': 1774699678.3739}
2026-03-28 12:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ED61814') HTTP/1.1" 204 0
2026-03-28 12:07:58 [auto1.it] INFO: Found listing with ID: EW91722
2026-03-28 12:07:58 [auto1.it] INFO: Found listing with ID: JC71555
2026-03-28 12:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC71555%27 HTTP/1.1" 200 None
2026-03-28 12:07:58 [auto1.it] INFO: Scrape type for JC71555: 0
2026-03-28 12:07:58 [auto1.it] INFO: Found listing with ID: ZF01645
2026-03-28 12:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF01645%27 HTTP/1.1" 200 None
2026-03-28 12:07:58 [auto1.it] INFO: Scrape type for ZF01645: 0
2026-03-28 12:07:58 [auto1.it] INFO: Found listing with ID: NX47141
2026-03-28 12:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX47141%27 HTTP/1.1" 200 None
2026-03-28 12:07:58 [auto1.it] INFO: Scrape type for NX47141: 0
2026-03-28 12:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:07:59 [auto1.it] INFO: Channel: 24h | Page: 29 | totalHits: 3675 | hits on page: 40
2026-03-28 12:07:59 [auto1.it] INFO: Found listing with ID: DN07271
2026-03-28 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN07271%27 HTTP/1.1" 200 None
2026-03-28 12:07:59 [auto1.it] INFO: Scrape type for DN07271: 0
2026-03-28 12:07:59 [auto1.it] INFO: Found listing with ID: GY11839
2026-03-28 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY11839%27 HTTP/1.1" 200 None
2026-03-28 12:07:59 [auto1.it] INFO: Scrape type for GY11839: 0
2026-03-28 12:07:59 [auto1.it] INFO: Found listing with ID: AV12122
2026-03-28 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV12122%27 HTTP/1.1" 200 None
2026-03-28 12:07:59 [auto1.it] INFO: Scrape type for AV12122: 0
2026-03-28 12:07:59 [auto1.it] INFO: Found listing with ID: TW69998
2026-03-28 12:07:59 [auto1.it] INFO: Found listing with ID: WX96902
2026-03-28 12:07:59 [auto1.it] INFO: Found listing with ID: ZZ84284
2026-03-28 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ84284%27 HTTP/1.1" 200 None
2026-03-28 12:07:59 [auto1.it] INFO: Scrape type for ZZ84284: 0
2026-03-28 12:07:59 [auto1.it] INFO: Found listing with ID: ST13349
2026-03-28 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST13349%27 HTTP/1.1" 200 None
2026-03-28 12:07:59 [auto1.it] INFO: Scrape type for ST13349: 0
2026-03-28 12:07:59 [auto1.it] INFO: Found listing with ID: AT74871
2026-03-28 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AT74871%27 HTTP/1.1" 200 None
2026-03-28 12:07:59 [auto1.it] INFO: Scrape type for AT74871: 0
2026-03-28 12:07:59 [auto1.it] INFO: Found listing with ID: LZ72377
2026-03-28 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ72377%27 HTTP/1.1" 200 None
2026-03-28 12:07:59 [auto1.it] INFO: Scrape type for LZ72377: 0
2026-03-28 12:07:59 [auto1.it] INFO: Found listing with ID: ZE71737
2026-03-28 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE71737%27 HTTP/1.1" 200 None
2026-03-28 12:07:59 [auto1.it] INFO: Scrape type for ZE71737: 0
2026-03-28 12:07:59 [auto1.it] INFO: Found listing with ID: LG98930
2026-03-28 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG98930%27 HTTP/1.1" 200 None
2026-03-28 12:07:59 [auto1.it] INFO: Scrape type for LG98930: 0
2026-03-28 12:07:59 [auto1.it] INFO: Found listing with ID: CX09724
2026-03-28 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CX09724%27 HTTP/1.1" 200 None
2026-03-28 12:07:59 [auto1.it] INFO: Scrape type for CX09724: 0
2026-03-28 12:07:59 [auto1.it] INFO: Found listing with ID: MK54778
2026-03-28 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MK54778%27 HTTP/1.1" 200 None
2026-03-28 12:07:59 [auto1.it] INFO: Scrape type for MK54778: 2
2026-03-28 12:07:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38dd8848-47a3-5e91-9fea-662ac2e9a8e0 with identifier: MK54778
2026-03-28 12:07:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38dd8848-47a3-5e91-9fea-662ac2e9a8e0 with scrape type 2
2026-03-28 12:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38dd8848-47a3-5e91-9fea-662ac2e9a8e0 with scrape type 2
2026-03-28 12:07:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 38dd8848-47a3-5e91-9fea-662ac2e9a8e0, identifier: MK54778
2026-03-28 12:07:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 38dd8848-47a3-5e91-9fea-662ac2e9a8e0 with identifier: MK54778
2026-03-28 12:07:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 38dd8848-47a3-5e91-9fea-662ac2e9a8e0 with identifier: MK54778
2026-03-28 12:07:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 38dd8848-47a3-5e91-9fea-662ac2e9a8e0 with identifier: MK54778 to the API
2026-03-28 12:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:07:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:07:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:09:31Z',
 'fuel_type': 'petrol',
 'id': '38dd8848-47a3-5e91-9fea-662ac2e9a8e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK54778',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 106081,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-12',
 'seller_name': None,
 'title': 'Dacia Sandero 1.4',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-28 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MK54778%27 HTTP/1.1" 200 None
2026-03-28 12:07:59 [auto1.it] INFO: Saving data for MK54778: {'auction_closing_time': 1774714171.0, 'created_time': 1773824745.86875, 'last_price_update_time': 1774699679.979823}
2026-03-28 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MK54778') HTTP/1.1" 204 0
2026-03-28 12:08:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:08:00 [auto1.it] INFO: Found listing with ID: PZ08956
2026-03-28 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ08956%27 HTTP/1.1" 200 None
2026-03-28 12:08:00 [auto1.it] INFO: Scrape type for PZ08956: 0
2026-03-28 12:08:00 [auto1.it] INFO: Found listing with ID: XY83174
2026-03-28 12:08:00 [auto1.it] INFO: Found listing with ID: JK67025
2026-03-28 12:08:00 [auto1.it] INFO: Found listing with ID: WS86026
2026-03-28 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WS86026%27 HTTP/1.1" 200 None
2026-03-28 12:08:00 [auto1.it] INFO: Scrape type for WS86026: 2
2026-03-28 12:08:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 694cb3d7-20e8-5b67-a055-d69f9cbb5bc8 with identifier: WS86026
2026-03-28 12:08:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 694cb3d7-20e8-5b67-a055-d69f9cbb5bc8 with scrape type 2
2026-03-28 12:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 694cb3d7-20e8-5b67-a055-d69f9cbb5bc8 with scrape type 2
2026-03-28 12:08:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 694cb3d7-20e8-5b67-a055-d69f9cbb5bc8, identifier: WS86026
2026-03-28 12:08:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 694cb3d7-20e8-5b67-a055-d69f9cbb5bc8 with identifier: WS86026
2026-03-28 12:08:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 694cb3d7-20e8-5b67-a055-d69f9cbb5bc8 with identifier: WS86026
2026-03-28 12:08:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 694cb3d7-20e8-5b67-a055-d69f9cbb5bc8 with identifier: WS86026 to the API
2026-03-28 12:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:29:16Z',
 'fuel_type': 'diesel',
 'id': '694cb3d7-20e8-5b67-a055-d69f9cbb5bc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS86026',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 143636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-01',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi Laureate 4x4',
 'transmission': 'manual',
 'trim': 'Laureate 4x4',
 'year': 2015}
2026-03-28 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WS86026%27 HTTP/1.1" 200 None
2026-03-28 12:08:00 [auto1.it] INFO: Saving data for WS86026: {'auction_closing_time': 1774715356.0, 'created_time': 1774516042.567502, 'last_price_update_time': 1774699680.597476}
2026-03-28 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WS86026') HTTP/1.1" 204 0
2026-03-28 12:08:00 [auto1.it] INFO: Found listing with ID: ZA88698
2026-03-28 12:08:00 [auto1.it] INFO: Found listing with ID: PM10461
2026-03-28 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM10461%27 HTTP/1.1" 200 None
2026-03-28 12:08:00 [auto1.it] INFO: Scrape type for PM10461: 0
2026-03-28 12:08:00 [auto1.it] INFO: Found listing with ID: SP76213
2026-03-28 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP76213%27 HTTP/1.1" 200 None
2026-03-28 12:08:00 [auto1.it] INFO: Scrape type for SP76213: 0
2026-03-28 12:08:00 [auto1.it] INFO: Found listing with ID: CS00409
2026-03-28 12:08:00 [auto1.it] INFO: Found listing with ID: VM52207
2026-03-28 12:08:00 [auto1.it] INFO: Found listing with ID: HA26046
2026-03-28 12:08:00 [auto1.it] INFO: Found listing with ID: NP04036
2026-03-28 12:08:00 [auto1.it] INFO: Found listing with ID: TR59701
2026-03-28 12:08:00 [auto1.it] INFO: Found listing with ID: KX10481
2026-03-28 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KX10481%27 HTTP/1.1" 200 None
2026-03-28 12:08:00 [auto1.it] INFO: Scrape type for KX10481: 0
2026-03-28 12:08:00 [auto1.it] INFO: Found listing with ID: YH31612
2026-03-28 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH31612%27 HTTP/1.1" 200 None
2026-03-28 12:08:00 [auto1.it] INFO: Scrape type for YH31612: 0
2026-03-28 12:08:00 [auto1.it] INFO: Found listing with ID: YM20104
2026-03-28 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM20104%27 HTTP/1.1" 200 None
2026-03-28 12:08:00 [auto1.it] INFO: Scrape type for YM20104: 0
2026-03-28 12:08:00 [auto1.it] INFO: Found listing with ID: NW69655
2026-03-28 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NW69655%27 HTTP/1.1" 200 None
2026-03-28 12:08:00 [auto1.it] INFO: Scrape type for NW69655: 0
2026-03-28 12:08:00 [auto1.it] INFO: Found listing with ID: GS12960
2026-03-28 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GS12960%27 HTTP/1.1" 200 None
2026-03-28 12:08:00 [auto1.it] INFO: Scrape type for GS12960: 0
2026-03-28 12:08:00 [auto1.it] INFO: Found listing with ID: LL73922
2026-03-28 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LL73922%27 HTTP/1.1" 200 None
2026-03-28 12:08:00 [auto1.it] INFO: Scrape type for LL73922: 0
2026-03-28 12:08:00 [auto1.it] INFO: Found listing with ID: CG84087
2026-03-28 12:08:00 [auto1.it] INFO: Found listing with ID: CV08843
2026-03-28 12:08:00 [auto1.it] INFO: Found listing with ID: RT64884
2026-03-28 12:08:00 [auto1.it] INFO: Found listing with ID: YX93099
2026-03-28 12:08:00 [auto1.it] INFO: Found listing with ID: TD31675
2026-03-28 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD31675%27 HTTP/1.1" 200 None
2026-03-28 12:08:00 [auto1.it] INFO: Scrape type for TD31675: 0
2026-03-28 12:08:00 [auto1.it] INFO: Found listing with ID: XJ00543
2026-03-28 12:08:00 [auto1.it] INFO: Found listing with ID: VX61752
2026-03-28 12:08:00 [auto1.it] INFO: Found listing with ID: RB12034
2026-03-28 12:08:00 [auto1.it] INFO: Found listing with ID: UX48429
2026-03-28 12:08:05 [scrapy.extensions.logstats] INFO: Crawled 225 pages (at 34 pages/min), scraped 137 items (at 42 items/min)
2026-03-28 12:08:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 200MiB
2026-03-28 12:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:08:11 [auto1.it] INFO: Channel: 24h | Page: 30 | totalHits: 3675 | hits on page: 40
2026-03-28 12:08:11 [auto1.it] INFO: Found listing with ID: AX27463
2026-03-28 12:08:11 [auto1.it] INFO: Found listing with ID: EB51163
2026-03-28 12:08:11 [auto1.it] INFO: Found listing with ID: UH08527
2026-03-28 12:08:11 [auto1.it] INFO: Found listing with ID: HR07647
2026-03-28 12:08:11 [auto1.it] INFO: Found listing with ID: PJ46449
2026-03-28 12:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PJ46449%27 HTTP/1.1" 200 None
2026-03-28 12:08:11 [auto1.it] INFO: Scrape type for PJ46449: 0
2026-03-28 12:08:11 [auto1.it] INFO: Found listing with ID: ZY55169
2026-03-28 12:08:11 [auto1.it] INFO: Found listing with ID: GX95672
2026-03-28 12:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX95672%27 HTTP/1.1" 200 None
2026-03-28 12:08:11 [auto1.it] INFO: Scrape type for GX95672: 2
2026-03-28 12:08:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb9503ef-80cf-593e-84a3-32f1d51afd3b with identifier: GX95672
2026-03-28 12:08:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb9503ef-80cf-593e-84a3-32f1d51afd3b with scrape type 2
2026-03-28 12:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb9503ef-80cf-593e-84a3-32f1d51afd3b with scrape type 2
2026-03-28 12:08:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: eb9503ef-80cf-593e-84a3-32f1d51afd3b, identifier: GX95672
2026-03-28 12:08:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: eb9503ef-80cf-593e-84a3-32f1d51afd3b with identifier: GX95672
2026-03-28 12:08:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: eb9503ef-80cf-593e-84a3-32f1d51afd3b with identifier: GX95672
2026-03-28 12:08:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: eb9503ef-80cf-593e-84a3-32f1d51afd3b with identifier: GX95672 to the API
2026-03-28 12:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:45:49Z',
 'fuel_type': 'diesel',
 'id': 'eb9503ef-80cf-593e-84a3-32f1d51afd3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX95672',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 280736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-07',
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi Allure L3',
 'transmission': 'automatic',
 'trim': 'Allure L3',
 'year': 2021}
2026-03-28 12:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX95672%27 HTTP/1.1" 200 None
2026-03-28 12:08:12 [auto1.it] INFO: Saving data for GX95672: {'auction_closing_time': 1774716349.0, 'created_time': 1774515967.031706, 'last_price_update_time': 1774699692.191493}
2026-03-28 12:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GX95672') HTTP/1.1" 204 0
2026-03-28 12:08:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:08:12 [auto1.it] INFO: Found listing with ID: SP14530
2026-03-28 12:08:12 [auto1.it] INFO: Found listing with ID: AA77653
2026-03-28 12:08:12 [auto1.it] INFO: Found listing with ID: XM03029
2026-03-28 12:08:12 [auto1.it] INFO: Found listing with ID: LK74969
2026-03-28 12:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LK74969%27 HTTP/1.1" 200 None
2026-03-28 12:08:12 [auto1.it] INFO: Scrape type for LK74969: 0
2026-03-28 12:08:12 [auto1.it] INFO: Found listing with ID: CB30744
2026-03-28 12:08:12 [auto1.it] INFO: Found listing with ID: RE87143
2026-03-28 12:08:12 [auto1.it] INFO: Found listing with ID: SN57039
2026-03-28 12:08:12 [auto1.it] INFO: Found listing with ID: KL78509
2026-03-28 12:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL78509%27 HTTP/1.1" 200 None
2026-03-28 12:08:12 [auto1.it] INFO: Scrape type for KL78509: 0
2026-03-28 12:08:12 [auto1.it] INFO: Found listing with ID: KU41331
2026-03-28 12:08:12 [auto1.it] INFO: Found listing with ID: TG15136
2026-03-28 12:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG15136%27 HTTP/1.1" 200 None
2026-03-28 12:08:12 [auto1.it] INFO: Scrape type for TG15136: 0
2026-03-28 12:08:12 [auto1.it] INFO: Found listing with ID: JF99544
2026-03-28 12:08:12 [auto1.it] INFO: Found listing with ID: JC73899
2026-03-28 12:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC73899%27 HTTP/1.1" 200 None
2026-03-28 12:08:12 [auto1.it] INFO: Scrape type for JC73899: 2
2026-03-28 12:08:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06058bc9-bf6b-563b-be0b-3aad842df464 with identifier: JC73899
2026-03-28 12:08:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06058bc9-bf6b-563b-be0b-3aad842df464 with scrape type 2
2026-03-28 12:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06058bc9-bf6b-563b-be0b-3aad842df464 with scrape type 2
2026-03-28 12:08:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 06058bc9-bf6b-563b-be0b-3aad842df464, identifier: JC73899
2026-03-28 12:08:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 06058bc9-bf6b-563b-be0b-3aad842df464 with identifier: JC73899
2026-03-28 12:08:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 06058bc9-bf6b-563b-be0b-3aad842df464 with identifier: JC73899
2026-03-28 12:08:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 06058bc9-bf6b-563b-be0b-3aad842df464 with identifier: JC73899 to the API
2026-03-28 12:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:44:26Z',
 'fuel_type': 'diesel',
 'id': '06058bc9-bf6b-563b-be0b-3aad842df464',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC73899',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 91306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-29',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Maxi Kasten BlueMotion',
 'transmission': 'manual',
 'trim': 'Maxi Kasten BlueMotion',
 'year': 2020}
2026-03-28 12:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC73899%27 HTTP/1.1" 200 None
2026-03-28 12:08:12 [auto1.it] INFO: Saving data for JC73899: {'auction_closing_time': 1774716266.0, 'created_time': 1774515955.397455, 'last_price_update_time': 1774699692.758994}
2026-03-28 12:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JC73899') HTTP/1.1" 204 0
2026-03-28 12:08:12 [auto1.it] INFO: Found listing with ID: ZA39687
2026-03-28 12:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZA39687%27 HTTP/1.1" 200 None
2026-03-28 12:08:12 [auto1.it] INFO: Scrape type for ZA39687: 0
2026-03-28 12:08:12 [auto1.it] INFO: Found listing with ID: JR96571
2026-03-28 12:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR96571%27 HTTP/1.1" 200 None
2026-03-28 12:08:12 [auto1.it] INFO: Scrape type for JR96571: 0
2026-03-28 12:08:12 [auto1.it] INFO: Found listing with ID: CK86990
2026-03-28 12:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK86990%27 HTTP/1.1" 200 None
2026-03-28 12:08:12 [auto1.it] INFO: Scrape type for CK86990: 0
2026-03-28 12:08:12 [auto1.it] INFO: Found listing with ID: PL52224
2026-03-28 12:08:12 [auto1.it] INFO: Found listing with ID: KU76175
2026-03-28 12:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KU76175%27 HTTP/1.1" 200 None
2026-03-28 12:08:12 [auto1.it] INFO: Scrape type for KU76175: 0
2026-03-28 12:08:12 [auto1.it] INFO: Found listing with ID: FF25963
2026-03-28 12:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF25963%27 HTTP/1.1" 200 None
2026-03-28 12:08:12 [auto1.it] INFO: Scrape type for FF25963: 0
2026-03-28 12:08:12 [auto1.it] INFO: Found listing with ID: SR16589
2026-03-28 12:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR16589%27 HTTP/1.1" 200 None
2026-03-28 12:08:12 [auto1.it] INFO: Scrape type for SR16589: 0
2026-03-28 12:08:12 [auto1.it] INFO: Found listing with ID: HU73227
2026-03-28 12:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU73227%27 HTTP/1.1" 200 None
2026-03-28 12:08:12 [auto1.it] INFO: Scrape type for HU73227: 0
2026-03-28 12:08:12 [auto1.it] INFO: Found listing with ID: PR39180
2026-03-28 12:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR39180%27 HTTP/1.1" 200 None
2026-03-28 12:08:13 [auto1.it] INFO: Scrape type for PR39180: 2
2026-03-28 12:08:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5006bb54-2d1e-5c35-9b8f-61745964636c with identifier: PR39180
2026-03-28 12:08:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5006bb54-2d1e-5c35-9b8f-61745964636c with scrape type 2
2026-03-28 12:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5006bb54-2d1e-5c35-9b8f-61745964636c with scrape type 2
2026-03-28 12:08:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5006bb54-2d1e-5c35-9b8f-61745964636c, identifier: PR39180
2026-03-28 12:08:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5006bb54-2d1e-5c35-9b8f-61745964636c with identifier: PR39180
2026-03-28 12:08:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5006bb54-2d1e-5c35-9b8f-61745964636c with identifier: PR39180
2026-03-28 12:08:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5006bb54-2d1e-5c35-9b8f-61745964636c with identifier: PR39180 to the API
2026-03-28 12:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:36:11Z',
 'fuel_type': 'diesel',
 'id': '5006bb54-2d1e-5c35-9b8f-61745964636c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR39180',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 48783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-29',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-28 12:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR39180%27 HTTP/1.1" 200 None
2026-03-28 12:08:13 [auto1.it] INFO: Saving data for PR39180: {'auction_closing_time': 1774715771.0, 'created_time': 1774516027.92693, 'last_price_update_time': 1774699693.384117}
2026-03-28 12:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PR39180') HTTP/1.1" 204 0
2026-03-28 12:08:13 [auto1.it] INFO: Found listing with ID: LW03785
2026-03-28 12:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW03785%27 HTTP/1.1" 200 None
2026-03-28 12:08:13 [auto1.it] INFO: Scrape type for LW03785: 0
2026-03-28 12:08:13 [auto1.it] INFO: Found listing with ID: PZ70422
2026-03-28 12:08:13 [auto1.it] INFO: Found listing with ID: AL46390
2026-03-28 12:08:13 [auto1.it] INFO: Found listing with ID: HP25104
2026-03-28 12:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP25104%27 HTTP/1.1" 200 None
2026-03-28 12:08:13 [auto1.it] INFO: Scrape type for HP25104: 0
2026-03-28 12:08:13 [auto1.it] INFO: Found listing with ID: BF43503
2026-03-28 12:08:13 [auto1.it] INFO: Found listing with ID: RA46767
2026-03-28 12:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA46767%27 HTTP/1.1" 200 None
2026-03-28 12:08:13 [auto1.it] INFO: Scrape type for RA46767: 0
2026-03-28 12:08:13 [auto1.it] INFO: Found listing with ID: ZH71174
2026-03-28 12:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH71174%27 HTTP/1.1" 200 None
2026-03-28 12:08:13 [auto1.it] INFO: Scrape type for ZH71174: 0
2026-03-28 12:08:13 [auto1.it] INFO: Found listing with ID: AP00004
2026-03-28 12:08:13 [auto1.it] INFO: Found listing with ID: VJ49724
2026-03-28 12:08:13 [auto1.it] INFO: Found listing with ID: VG29105
2026-03-28 12:08:13 [auto1.it] INFO: Found listing with ID: CB60846
2026-03-28 12:08:13 [auto1.it] INFO: Found listing with ID: ZU34198
2026-03-28 12:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU34198%27 HTTP/1.1" 200 None
2026-03-28 12:08:13 [auto1.it] INFO: Scrape type for ZU34198: 2
2026-03-28 12:08:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c922836a-54b9-55ad-b5e6-7d146ab1c3a1 with identifier: ZU34198
2026-03-28 12:08:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c922836a-54b9-55ad-b5e6-7d146ab1c3a1 with scrape type 2
2026-03-28 12:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c922836a-54b9-55ad-b5e6-7d146ab1c3a1 with scrape type 2
2026-03-28 12:08:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c922836a-54b9-55ad-b5e6-7d146ab1c3a1, identifier: ZU34198
2026-03-28 12:08:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c922836a-54b9-55ad-b5e6-7d146ab1c3a1 with identifier: ZU34198
2026-03-28 12:08:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c922836a-54b9-55ad-b5e6-7d146ab1c3a1 with identifier: ZU34198
2026-03-28 12:08:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c922836a-54b9-55ad-b5e6-7d146ab1c3a1 with identifier: ZU34198 to the API
2026-03-28 12:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:17:57Z',
 'fuel_type': 'petrol',
 'id': 'c922836a-54b9-55ad-b5e6-7d146ab1c3a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU34198',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Cruze',
 'odometer': 167073,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-11',
 'seller_name': None,
 'title': 'Chevrolet Cruze 1.6 LT',
 'transmission': 'manual',
 'trim': 'LT',
 'year': 2011}
2026-03-28 12:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU34198%27 HTTP/1.1" 200 None
2026-03-28 12:08:13 [auto1.it] INFO: Saving data for ZU34198: {'auction_closing_time': 1774714677.0, 'created_time': 1774515962.921386, 'last_price_update_time': 1774699693.879107}
2026-03-28 12:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZU34198') HTTP/1.1" 204 0
2026-03-28 12:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:08:15 [auto1.it] INFO: Channel: 24h | Page: 31 | totalHits: 3675 | hits on page: 40
2026-03-28 12:08:15 [auto1.it] INFO: Found listing with ID: TW04222
2026-03-28 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW04222%27 HTTP/1.1" 200 None
2026-03-28 12:08:15 [auto1.it] INFO: Scrape type for TW04222: 0
2026-03-28 12:08:15 [auto1.it] INFO: Found listing with ID: CB25121
2026-03-28 12:08:15 [auto1.it] INFO: Found listing with ID: DA23296
2026-03-28 12:08:15 [auto1.it] INFO: Found listing with ID: PN87184
2026-03-28 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN87184%27 HTTP/1.1" 200 None
2026-03-28 12:08:15 [auto1.it] INFO: Scrape type for PN87184: 0
2026-03-28 12:08:15 [auto1.it] INFO: Found listing with ID: NV88375
2026-03-28 12:08:15 [auto1.it] INFO: Found listing with ID: JY18899
2026-03-28 12:08:15 [auto1.it] INFO: Found listing with ID: BA93594
2026-03-28 12:08:15 [auto1.it] INFO: Found listing with ID: YM08087
2026-03-28 12:08:15 [auto1.it] INFO: Found listing with ID: CM37896
2026-03-28 12:08:15 [auto1.it] INFO: Found listing with ID: EK96047
2026-03-28 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK96047%27 HTTP/1.1" 200 None
2026-03-28 12:08:15 [auto1.it] INFO: Scrape type for EK96047: 0
2026-03-28 12:08:15 [auto1.it] INFO: Found listing with ID: JD15995
2026-03-28 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD15995%27 HTTP/1.1" 200 None
2026-03-28 12:08:15 [auto1.it] INFO: Scrape type for JD15995: 0
2026-03-28 12:08:15 [auto1.it] INFO: Found listing with ID: LW17354
2026-03-28 12:08:15 [auto1.it] INFO: Found listing with ID: JS97160
2026-03-28 12:08:15 [auto1.it] INFO: Found listing with ID: TZ48601
2026-03-28 12:08:15 [auto1.it] INFO: Found listing with ID: AY64399
2026-03-28 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY64399%27 HTTP/1.1" 200 None
2026-03-28 12:08:15 [auto1.it] INFO: Scrape type for AY64399: 0
2026-03-28 12:08:15 [auto1.it] INFO: Found listing with ID: SG52105
2026-03-28 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG52105%27 HTTP/1.1" 200 None
2026-03-28 12:08:15 [auto1.it] INFO: Scrape type for SG52105: 2
2026-03-28 12:08:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff6dea23-4996-5906-bfa1-f28e28444ddc with identifier: SG52105
2026-03-28 12:08:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff6dea23-4996-5906-bfa1-f28e28444ddc with scrape type 2
2026-03-28 12:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff6dea23-4996-5906-bfa1-f28e28444ddc with scrape type 2
2026-03-28 12:08:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ff6dea23-4996-5906-bfa1-f28e28444ddc, identifier: SG52105
2026-03-28 12:08:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ff6dea23-4996-5906-bfa1-f28e28444ddc with identifier: SG52105
2026-03-28 12:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:08:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-28 12:08:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:08:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ff6dea23-4996-5906-bfa1-f28e28444ddc with identifier: SG52105
2026-03-28 12:08:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ff6dea23-4996-5906-bfa1-f28e28444ddc with identifier: SG52105 to the API
2026-03-28 12:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-28T16:23:39Z',
 'fuel_type': 'hybrid',
 'id': 'ff6dea23-4996-5906-bfa1-f28e28444ddc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG52105',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 166755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-28',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.5 Hybrid Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2016}
2026-03-28 12:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG52105%27 HTTP/1.1" 200 None
2026-03-28 12:08:16 [auto1.it] INFO: Saving data for SG52105: {'auction_closing_time': 1774715019.0, 'created_time': 1774515956.578046, 'last_price_update_time': 1774699696.511921}
2026-03-28 12:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SG52105') HTTP/1.1" 204 0
2026-03-28 12:08:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:08:16 [auto1.it] INFO: Found listing with ID: YV94917
2026-03-28 12:08:16 [auto1.it] INFO: Found listing with ID: SD31467
2026-03-28 12:08:16 [auto1.it] INFO: Found listing with ID: YH31345
2026-03-28 12:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH31345%27 HTTP/1.1" 200 None
2026-03-28 12:08:16 [auto1.it] INFO: Scrape type for YH31345: 2
2026-03-28 12:08:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85026d01-09af-528c-9a08-106b903080a9 with identifier: YH31345
2026-03-28 12:08:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85026d01-09af-528c-9a08-106b903080a9 with scrape type 2
2026-03-28 12:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85026d01-09af-528c-9a08-106b903080a9 with scrape type 2
2026-03-28 12:08:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 85026d01-09af-528c-9a08-106b903080a9, identifier: YH31345
2026-03-28 12:08:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 85026d01-09af-528c-9a08-106b903080a9 with identifier: YH31345
2026-03-28 12:08:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 85026d01-09af-528c-9a08-106b903080a9 with identifier: YH31345
2026-03-28 12:08:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 85026d01-09af-528c-9a08-106b903080a9 with identifier: YH31345 to the API
2026-03-28 12:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:30:51Z',
 'fuel_type': 'diesel',
 'id': '85026d01-09af-528c-9a08-106b903080a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH31345',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Captiva',
 'odometer': 209107,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-03',
 'seller_name': None,
 'title': 'Chevrolet Captiva 2.0 Diesel D LT 4WD',
 'transmission': 'automatic',
 'trim': 'D LT 4WD',
 'year': 2008}
2026-03-28 12:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH31345%27 HTTP/1.1" 200 None
2026-03-28 12:08:17 [auto1.it] INFO: Saving data for YH31345: {'auction_closing_time': 1774715451.0, 'created_time': 1772309107.164025, 'last_price_update_time': 1774699697.040706}
2026-03-28 12:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YH31345') HTTP/1.1" 204 0
2026-03-28 12:08:17 [auto1.it] INFO: Found listing with ID: AF62726
2026-03-28 12:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF62726%27 HTTP/1.1" 200 None
2026-03-28 12:08:17 [auto1.it] INFO: Scrape type for AF62726: 0
2026-03-28 12:08:17 [auto1.it] INFO: Found listing with ID: ZD65765
2026-03-28 12:08:17 [auto1.it] INFO: Found listing with ID: CW24266
2026-03-28 12:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW24266%27 HTTP/1.1" 200 None
2026-03-28 12:08:17 [auto1.it] INFO: Scrape type for CW24266: 0
2026-03-28 12:08:17 [auto1.it] INFO: Found listing with ID: YD38640
2026-03-28 12:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD38640%27 HTTP/1.1" 200 None
2026-03-28 12:08:17 [auto1.it] INFO: Scrape type for YD38640: 0
2026-03-28 12:08:17 [auto1.it] INFO: Found listing with ID: NF26556
2026-03-28 12:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF26556%27 HTTP/1.1" 200 None
2026-03-28 12:08:17 [auto1.it] INFO: Scrape type for NF26556: 0
2026-03-28 12:08:17 [auto1.it] INFO: Found listing with ID: VN28128
2026-03-28 12:08:17 [auto1.it] INFO: Found listing with ID: PS25996
2026-03-28 12:08:17 [auto1.it] INFO: Found listing with ID: JL83734
2026-03-28 12:08:17 [auto1.it] INFO: Found listing with ID: WG31996
2026-03-28 12:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG31996%27 HTTP/1.1" 200 None
2026-03-28 12:08:17 [auto1.it] INFO: Scrape type for WG31996: 0
2026-03-28 12:08:17 [auto1.it] INFO: Found listing with ID: XZ26785
2026-03-28 12:08:17 [auto1.it] INFO: Found listing with ID: PL66586
2026-03-28 12:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PL66586%27 HTTP/1.1" 200 None
2026-03-28 12:08:17 [auto1.it] INFO: Scrape type for PL66586: 0
2026-03-28 12:08:17 [auto1.it] INFO: Found listing with ID: FD29696
2026-03-28 12:08:17 [auto1.it] INFO: Found listing with ID: TH27811
2026-03-28 12:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH27811%27 HTTP/1.1" 200 None
2026-03-28 12:08:17 [auto1.it] INFO: Scrape type for TH27811: 0
2026-03-28 12:08:17 [auto1.it] INFO: Found listing with ID: HT57713
2026-03-28 12:08:17 [auto1.it] INFO: Found listing with ID: KD83488
2026-03-28 12:08:17 [auto1.it] INFO: Found listing with ID: DC26275
2026-03-28 12:08:17 [auto1.it] INFO: Found listing with ID: VX48328
2026-03-28 12:08:17 [auto1.it] INFO: Found listing with ID: HU51198
2026-03-28 12:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU51198%27 HTTP/1.1" 200 None
2026-03-28 12:08:17 [auto1.it] INFO: Scrape type for HU51198: 0
2026-03-28 12:08:17 [auto1.it] INFO: Found listing with ID: WP70299
2026-03-28 12:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP70299%27 HTTP/1.1" 200 None
2026-03-28 12:08:17 [auto1.it] INFO: Scrape type for WP70299: 0
2026-03-28 12:08:17 [auto1.it] INFO: Found listing with ID: EA17133
2026-03-28 12:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA17133%27 HTTP/1.1" 200 None
2026-03-28 12:08:17 [auto1.it] INFO: Scrape type for EA17133: 0
2026-03-28 12:08:17 [auto1.it] INFO: Found listing with ID: AU09842
2026-03-28 12:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU09842%27 HTTP/1.1" 200 None
2026-03-28 12:08:17 [auto1.it] INFO: Scrape type for AU09842: 0
2026-03-28 12:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:08:18 [auto1.it] INFO: Channel: 24h | Page: 32 | totalHits: 3675 | hits on page: 40
2026-03-28 12:08:18 [auto1.it] INFO: Found listing with ID: VS08893
2026-03-28 12:08:18 [auto1.it] INFO: Found listing with ID: RP80474
2026-03-28 12:08:18 [auto1.it] INFO: Found listing with ID: AM02692
2026-03-28 12:08:18 [auto1.it] INFO: Found listing with ID: LY27741
2026-03-28 12:08:18 [auto1.it] INFO: Found listing with ID: SE55523
2026-03-28 12:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE55523%27 HTTP/1.1" 200 None
2026-03-28 12:08:18 [auto1.it] INFO: Scrape type for SE55523: 0
2026-03-28 12:08:18 [auto1.it] INFO: Found listing with ID: TA36833
2026-03-28 12:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TA36833%27 HTTP/1.1" 200 None
2026-03-28 12:08:18 [auto1.it] INFO: Scrape type for TA36833: 0
2026-03-28 12:08:18 [auto1.it] INFO: Found listing with ID: BE49358
2026-03-28 12:08:18 [auto1.it] INFO: Found listing with ID: HY06064
2026-03-28 12:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY06064%27 HTTP/1.1" 200 None
2026-03-28 12:08:18 [auto1.it] INFO: Scrape type for HY06064: 0
2026-03-28 12:08:18 [auto1.it] INFO: Found listing with ID: EC55479
2026-03-28 12:08:18 [auto1.it] INFO: Found listing with ID: GZ47839
2026-03-28 12:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ47839%27 HTTP/1.1" 200 None
2026-03-28 12:08:18 [auto1.it] INFO: Scrape type for GZ47839: 0
2026-03-28 12:08:18 [auto1.it] INFO: Found listing with ID: MN87452
2026-03-28 12:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN87452%27 HTTP/1.1" 200 None
2026-03-28 12:08:18 [auto1.it] INFO: Scrape type for MN87452: 0
2026-03-28 12:08:18 [auto1.it] INFO: Found listing with ID: XY19791
2026-03-28 12:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY19791%27 HTTP/1.1" 200 None
2026-03-28 12:08:18 [auto1.it] INFO: Scrape type for XY19791: 2
2026-03-28 12:08:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2694a62b-4f90-54fc-8073-84656c7eada8 with identifier: XY19791
2026-03-28 12:08:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2694a62b-4f90-54fc-8073-84656c7eada8 with scrape type 2
2026-03-28 12:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2694a62b-4f90-54fc-8073-84656c7eada8 with scrape type 2
2026-03-28 12:08:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2694a62b-4f90-54fc-8073-84656c7eada8, identifier: XY19791
2026-03-28 12:08:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2694a62b-4f90-54fc-8073-84656c7eada8 with identifier: XY19791
2026-03-28 12:08:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2694a62b-4f90-54fc-8073-84656c7eada8 with identifier: XY19791
2026-03-28 12:08:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2694a62b-4f90-54fc-8073-84656c7eada8 with identifier: XY19791 to the API
2026-03-28 12:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:07:25Z',
 'fuel_type': 'diesel',
 'id': '2694a62b-4f90-54fc-8073-84656c7eada8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY19791',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 105954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-09',
 'seller_name': None,
 'title': 'Fiat 500L 1.6 JTDM Trekking',
 'transmission': 'manual',
 'trim': 'Trekking',
 'year': 2014}
2026-03-28 12:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY19791%27 HTTP/1.1" 200 None
2026-03-28 12:08:18 [auto1.it] INFO: Saving data for XY19791: {'auction_closing_time': 1774714045.0, 'created_time': 1774101976.883389, 'last_price_update_time': 1774699698.761705}
2026-03-28 12:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XY19791') HTTP/1.1" 204 0
2026-03-28 12:08:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:08:18 [auto1.it] INFO: Found listing with ID: NB30939
2026-03-28 12:08:18 [auto1.it] INFO: Found listing with ID: TA75240
2026-03-28 12:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TA75240%27 HTTP/1.1" 200 None
2026-03-28 12:08:18 [auto1.it] INFO: Scrape type for TA75240: 0
2026-03-28 12:08:18 [auto1.it] INFO: Found listing with ID: PA17142
2026-03-28 12:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA17142%27 HTTP/1.1" 200 None
2026-03-28 12:08:18 [auto1.it] INFO: Scrape type for PA17142: 0
2026-03-28 12:08:18 [auto1.it] INFO: Found listing with ID: FL87170
2026-03-28 12:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL87170%27 HTTP/1.1" 200 None
2026-03-28 12:08:18 [auto1.it] INFO: Scrape type for FL87170: 0
2026-03-28 12:08:18 [auto1.it] INFO: Found listing with ID: FB70845
2026-03-28 12:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB70845%27 HTTP/1.1" 200 None
2026-03-28 12:08:18 [auto1.it] INFO: Scrape type for FB70845: 0
2026-03-28 12:08:18 [auto1.it] INFO: Found listing with ID: AU70231
2026-03-28 12:08:18 [auto1.it] INFO: Found listing with ID: EZ99260
2026-03-28 12:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ99260%27 HTTP/1.1" 200 None
2026-03-28 12:08:19 [auto1.it] INFO: Scrape type for EZ99260: 0
2026-03-28 12:08:19 [auto1.it] INFO: Found listing with ID: DG86254
2026-03-28 12:08:19 [auto1.it] INFO: Found listing with ID: RG08073
2026-03-28 12:08:19 [auto1.it] INFO: Found listing with ID: KJ53675
2026-03-28 12:08:19 [auto1.it] INFO: Found listing with ID: SY54017
2026-03-28 12:08:19 [auto1.it] INFO: Found listing with ID: BT65910
2026-03-28 12:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT65910%27 HTTP/1.1" 200 None
2026-03-28 12:08:19 [auto1.it] INFO: Scrape type for BT65910: 0
2026-03-28 12:08:19 [auto1.it] INFO: Found listing with ID: SS15336
2026-03-28 12:08:19 [auto1.it] INFO: Found listing with ID: GJ83032
2026-03-28 12:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ83032%27 HTTP/1.1" 200 None
2026-03-28 12:08:19 [auto1.it] INFO: Scrape type for GJ83032: 0
2026-03-28 12:08:19 [auto1.it] INFO: Found listing with ID: XJ82802
2026-03-28 12:08:19 [auto1.it] INFO: Found listing with ID: JK56152
2026-03-28 12:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK56152%27 HTTP/1.1" 200 None
2026-03-28 12:08:19 [auto1.it] INFO: Scrape type for JK56152: 0
2026-03-28 12:08:19 [auto1.it] INFO: Found listing with ID: NZ90613
2026-03-28 12:08:19 [auto1.it] INFO: Found listing with ID: JH99386
2026-03-28 12:08:19 [auto1.it] INFO: Found listing with ID: GE08005
2026-03-28 12:08:19 [auto1.it] INFO: Found listing with ID: LT53678
2026-03-28 12:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LT53678%27 HTTP/1.1" 200 None
2026-03-28 12:08:19 [auto1.it] INFO: Scrape type for LT53678: 0
2026-03-28 12:08:19 [auto1.it] INFO: Found listing with ID: FU79114
2026-03-28 12:08:19 [auto1.it] INFO: Found listing with ID: LV68988
2026-03-28 12:08:19 [auto1.it] INFO: Found listing with ID: UN42756
2026-03-28 12:08:19 [auto1.it] INFO: Found listing with ID: SZ24732
2026-03-28 12:08:19 [auto1.it] INFO: Found listing with ID: WT09600
2026-03-28 12:08:19 [auto1.it] INFO: Found listing with ID: XN00477
2026-03-28 12:08:19 [auto1.it] INFO: Found listing with ID: EP46295
2026-03-28 12:08:19 [auto1.it] INFO: Found listing with ID: WY28975
2026-03-28 12:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:08:19 [auto1.it] INFO: Channel: 24h | Page: 33 | totalHits: 3675 | hits on page: 40
2026-03-28 12:08:19 [auto1.it] INFO: Found listing with ID: FG66384
2026-03-28 12:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG66384%27 HTTP/1.1" 200 None
2026-03-28 12:08:20 [auto1.it] INFO: Scrape type for FG66384: 0
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: HB99393
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: SG75657
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: ZM53307
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: CN94330
2026-03-28 12:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN94330%27 HTTP/1.1" 200 None
2026-03-28 12:08:20 [auto1.it] INFO: Scrape type for CN94330: 0
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: ME96207
2026-03-28 12:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME96207%27 HTTP/1.1" 200 None
2026-03-28 12:08:20 [auto1.it] INFO: Scrape type for ME96207: 0
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: ET79230
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: PL88516
2026-03-28 12:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PL88516%27 HTTP/1.1" 200 None
2026-03-28 12:08:20 [auto1.it] INFO: Scrape type for PL88516: 0
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: AB63446
2026-03-28 12:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB63446%27 HTTP/1.1" 200 None
2026-03-28 12:08:20 [auto1.it] INFO: Scrape type for AB63446: 0
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: AG45482
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: UT31107
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: BE28605
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: KU20000
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: BR59197
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: GL68572
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: AH48855
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: DD73045
2026-03-28 12:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD73045%27 HTTP/1.1" 200 None
2026-03-28 12:08:20 [auto1.it] INFO: Scrape type for DD73045: 0
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: US62865
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: VB10041
2026-03-28 12:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB10041%27 HTTP/1.1" 200 None
2026-03-28 12:08:20 [auto1.it] INFO: Scrape type for VB10041: 0
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: LS85229
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: GN54162
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: TM85458
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: UW44918
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: BE09297
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: ZD06174
2026-03-28 12:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD06174%27 HTTP/1.1" 200 None
2026-03-28 12:08:20 [auto1.it] INFO: Scrape type for ZD06174: 0
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: ZM37074
2026-03-28 12:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM37074%27 HTTP/1.1" 200 None
2026-03-28 12:08:20 [auto1.it] INFO: Scrape type for ZM37074: 0
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: DZ91111
2026-03-28 12:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ91111%27 HTTP/1.1" 200 None
2026-03-28 12:08:20 [auto1.it] INFO: Scrape type for DZ91111: 0
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: PL95293
2026-03-28 12:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PL95293%27 HTTP/1.1" 200 None
2026-03-28 12:08:20 [auto1.it] INFO: Scrape type for PL95293: 0
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: LC48470
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: RM58290
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: CT52714
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: AM26734
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: XT06571
2026-03-28 12:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT06571%27 HTTP/1.1" 200 None
2026-03-28 12:08:20 [auto1.it] INFO: Scrape type for XT06571: 0
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: ZR51869
2026-03-28 12:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR51869%27 HTTP/1.1" 200 None
2026-03-28 12:08:20 [auto1.it] INFO: Scrape type for ZR51869: 0
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: XL05283
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: RC86938
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: XB17509
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: EV67408
2026-03-28 12:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV67408%27 HTTP/1.1" 200 None
2026-03-28 12:08:20 [auto1.it] INFO: Scrape type for EV67408: 0
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: BX32751
2026-03-28 12:08:20 [auto1.it] INFO: Found listing with ID: HX97698
2026-03-28 12:08:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:08:21 [auto1.it] INFO: Channel: 24h | Page: 34 | totalHits: 3675 | hits on page: 40
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: LU41088
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU41088%27 HTTP/1.1" 200 None
2026-03-28 12:08:21 [auto1.it] INFO: Scrape type for LU41088: 0
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: JA23612
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: WV29949
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: XT85260
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: EA68503
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA68503%27 HTTP/1.1" 200 None
2026-03-28 12:08:21 [auto1.it] INFO: Scrape type for EA68503: 0
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: TK21590
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: LV91282
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV91282%27 HTTP/1.1" 200 None
2026-03-28 12:08:21 [auto1.it] INFO: Scrape type for LV91282: 0
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: WC44789
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: NF30981
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF30981%27 HTTP/1.1" 200 None
2026-03-28 12:08:21 [auto1.it] INFO: Scrape type for NF30981: 0
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: UV29542
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UV29542%27 HTTP/1.1" 200 None
2026-03-28 12:08:21 [auto1.it] INFO: Scrape type for UV29542: 0
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: EE95145
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE95145%27 HTTP/1.1" 200 None
2026-03-28 12:08:21 [auto1.it] INFO: Scrape type for EE95145: 0
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: BD71903
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: AY66790
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY66790%27 HTTP/1.1" 200 None
2026-03-28 12:08:21 [auto1.it] INFO: Scrape type for AY66790: 0
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: NF08896
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF08896%27 HTTP/1.1" 200 None
2026-03-28 12:08:21 [auto1.it] INFO: Scrape type for NF08896: 0
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: SS87934
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS87934%27 HTTP/1.1" 200 None
2026-03-28 12:08:21 [auto1.it] INFO: Scrape type for SS87934: 0
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: HP55152
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP55152%27 HTTP/1.1" 200 None
2026-03-28 12:08:21 [auto1.it] INFO: Scrape type for HP55152: 0
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: JV35295
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: ED24082
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED24082%27 HTTP/1.1" 200 None
2026-03-28 12:08:21 [auto1.it] INFO: Scrape type for ED24082: 0
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: WX67440
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WX67440%27 HTTP/1.1" 200 None
2026-03-28 12:08:21 [auto1.it] INFO: Scrape type for WX67440: 0
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: GR86359
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: DW12727
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: SE81174
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE81174%27 HTTP/1.1" 200 None
2026-03-28 12:08:21 [auto1.it] INFO: Scrape type for SE81174: 0
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: VZ97279
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: BN27649
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: JR54930
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR54930%27 HTTP/1.1" 200 None
2026-03-28 12:08:21 [auto1.it] INFO: Scrape type for JR54930: 0
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: RZ16714
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: WL53251
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: RF41966
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: DV87281
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV87281%27 HTTP/1.1" 200 None
2026-03-28 12:08:21 [auto1.it] INFO: Scrape type for DV87281: 0
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: LP60965
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LP60965%27 HTTP/1.1" 200 None
2026-03-28 12:08:21 [auto1.it] INFO: Scrape type for LP60965: 0
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: SS74594
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS74594%27 HTTP/1.1" 200 None
2026-03-28 12:08:21 [auto1.it] INFO: Scrape type for SS74594: 0
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: GA52227
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA52227%27 HTTP/1.1" 200 None
2026-03-28 12:08:21 [auto1.it] INFO: Scrape type for GA52227: 0
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: SE94922
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: KC15841
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: AL92131
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: SP03533
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: EP94562
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: HP33672
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP33672%27 HTTP/1.1" 200 None
2026-03-28 12:08:21 [auto1.it] INFO: Scrape type for HP33672: 0
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: PZ35188
2026-03-28 12:08:21 [auto1.it] INFO: Found listing with ID: XK43361
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XK43361%27 HTTP/1.1" 200 None
2026-03-28 12:08:21 [auto1.it] INFO: Scrape type for XK43361: 0
2026-03-28 12:08:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:08:22 [auto1.it] INFO: Channel: 24h | Page: 35 | totalHits: 3675 | hits on page: 40
2026-03-28 12:08:22 [auto1.it] INFO: Found listing with ID: AF46529
2026-03-28 12:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF46529%27 HTTP/1.1" 200 None
2026-03-28 12:08:22 [auto1.it] INFO: Scrape type for AF46529: 0
2026-03-28 12:08:22 [auto1.it] INFO: Found listing with ID: DR37659
2026-03-28 12:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR37659%27 HTTP/1.1" 200 None
2026-03-28 12:08:22 [auto1.it] INFO: Scrape type for DR37659: 0
2026-03-28 12:08:22 [auto1.it] INFO: Found listing with ID: RA62003
2026-03-28 12:08:22 [auto1.it] INFO: Found listing with ID: PX04626
2026-03-28 12:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PX04626%27 HTTP/1.1" 200 None
2026-03-28 12:08:22 [auto1.it] INFO: Scrape type for PX04626: 0
2026-03-28 12:08:22 [auto1.it] INFO: Found listing with ID: JJ49663
2026-03-28 12:08:22 [auto1.it] INFO: Found listing with ID: NC94766
2026-03-28 12:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC94766%27 HTTP/1.1" 200 None
2026-03-28 12:08:22 [auto1.it] INFO: Scrape type for NC94766: 0
2026-03-28 12:08:22 [auto1.it] INFO: Found listing with ID: TM14031
2026-03-28 12:08:22 [auto1.it] INFO: Found listing with ID: TG82781
2026-03-28 12:08:22 [auto1.it] INFO: Found listing with ID: ES51073
2026-03-28 12:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES51073%27 HTTP/1.1" 200 None
2026-03-28 12:08:22 [auto1.it] INFO: Scrape type for ES51073: 0
2026-03-28 12:08:22 [auto1.it] INFO: Found listing with ID: FT97220
2026-03-28 12:08:22 [auto1.it] INFO: Found listing with ID: WU99232
2026-03-28 12:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU99232%27 HTTP/1.1" 200 None
2026-03-28 12:08:22 [auto1.it] INFO: Scrape type for WU99232: 2
2026-03-28 12:08:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb6bbb63-02f3-514c-b0ae-cd095d14873b with identifier: WU99232
2026-03-28 12:08:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb6bbb63-02f3-514c-b0ae-cd095d14873b with scrape type 2
2026-03-28 12:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb6bbb63-02f3-514c-b0ae-cd095d14873b with scrape type 2
2026-03-28 12:08:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cb6bbb63-02f3-514c-b0ae-cd095d14873b, identifier: WU99232
2026-03-28 12:08:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cb6bbb63-02f3-514c-b0ae-cd095d14873b with identifier: WU99232
2026-03-28 12:08:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cb6bbb63-02f3-514c-b0ae-cd095d14873b with identifier: WU99232
2026-03-28 12:08:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cb6bbb63-02f3-514c-b0ae-cd095d14873b with identifier: WU99232 to the API
2026-03-28 12:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:39:00Z',
 'fuel_type': 'diesel',
 'id': 'cb6bbb63-02f3-514c-b0ae-cd095d14873b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU99232',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 165105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-21',
 'seller_name': None,
 'title': 'BMW 4er 420d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU99232%27 HTTP/1.1" 200 None
2026-03-28 12:08:23 [auto1.it] INFO: Saving data for WU99232: {'auction_closing_time': 1774715940.0, 'created_time': 1774515997.560226, 'last_price_update_time': 1774699703.103256}
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WU99232') HTTP/1.1" 204 0
2026-03-28 12:08:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:08:23 [auto1.it] INFO: Found listing with ID: SA50428
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SA50428%27 HTTP/1.1" 200 None
2026-03-28 12:08:23 [auto1.it] INFO: Scrape type for SA50428: 0
2026-03-28 12:08:23 [auto1.it] INFO: Found listing with ID: JJ80566
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ80566%27 HTTP/1.1" 200 None
2026-03-28 12:08:23 [auto1.it] INFO: Scrape type for JJ80566: 0
2026-03-28 12:08:23 [auto1.it] INFO: Found listing with ID: WH82404
2026-03-28 12:08:23 [auto1.it] INFO: Found listing with ID: KC02263
2026-03-28 12:08:23 [auto1.it] INFO: Found listing with ID: WX97705
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WX97705%27 HTTP/1.1" 200 None
2026-03-28 12:08:23 [auto1.it] INFO: Scrape type for WX97705: 0
2026-03-28 12:08:23 [auto1.it] INFO: Found listing with ID: GH19384
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GH19384%27 HTTP/1.1" 200 None
2026-03-28 12:08:23 [auto1.it] INFO: Scrape type for GH19384: 0
2026-03-28 12:08:23 [auto1.it] INFO: Found listing with ID: NR23984
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR23984%27 HTTP/1.1" 200 None
2026-03-28 12:08:23 [auto1.it] INFO: Scrape type for NR23984: 0
2026-03-28 12:08:23 [auto1.it] INFO: Found listing with ID: CJ26443
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CJ26443%27 HTTP/1.1" 200 None
2026-03-28 12:08:23 [auto1.it] INFO: Scrape type for CJ26443: 0
2026-03-28 12:08:23 [auto1.it] INFO: Found listing with ID: EC13131
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC13131%27 HTTP/1.1" 200 None
2026-03-28 12:08:23 [auto1.it] INFO: Scrape type for EC13131: 0
2026-03-28 12:08:23 [auto1.it] INFO: Found listing with ID: GU38190
2026-03-28 12:08:23 [auto1.it] INFO: Found listing with ID: YH62584
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH62584%27 HTTP/1.1" 200 None
2026-03-28 12:08:23 [auto1.it] INFO: Scrape type for YH62584: 0
2026-03-28 12:08:23 [auto1.it] INFO: Found listing with ID: SN06060
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN06060%27 HTTP/1.1" 200 None
2026-03-28 12:08:23 [auto1.it] INFO: Scrape type for SN06060: 0
2026-03-28 12:08:23 [auto1.it] INFO: Found listing with ID: ZJ24732
2026-03-28 12:08:23 [auto1.it] INFO: Found listing with ID: GR20661
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR20661%27 HTTP/1.1" 200 None
2026-03-28 12:08:23 [auto1.it] INFO: Scrape type for GR20661: 0
2026-03-28 12:08:23 [auto1.it] INFO: Found listing with ID: YK56738
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YK56738%27 HTTP/1.1" 200 None
2026-03-28 12:08:23 [auto1.it] INFO: Scrape type for YK56738: 0
2026-03-28 12:08:23 [auto1.it] INFO: Found listing with ID: GW87429
2026-03-28 12:08:23 [auto1.it] INFO: Found listing with ID: BH09542
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BH09542%27 HTTP/1.1" 200 None
2026-03-28 12:08:23 [auto1.it] INFO: Scrape type for BH09542: 0
2026-03-28 12:08:23 [auto1.it] INFO: Found listing with ID: NM70552
2026-03-28 12:08:23 [auto1.it] INFO: Found listing with ID: HH07211
2026-03-28 12:08:23 [auto1.it] INFO: Found listing with ID: SY55940
2026-03-28 12:08:23 [auto1.it] INFO: Found listing with ID: HU85714
2026-03-28 12:08:23 [auto1.it] INFO: Found listing with ID: SN24706
2026-03-28 12:08:23 [auto1.it] INFO: Found listing with ID: ZP79936
2026-03-28 12:08:23 [auto1.it] INFO: Found listing with ID: NL88933
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL88933%27 HTTP/1.1" 200 None
2026-03-28 12:08:23 [auto1.it] INFO: Scrape type for NL88933: 0
2026-03-28 12:08:23 [auto1.it] INFO: Found listing with ID: HD78178
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD78178%27 HTTP/1.1" 200 None
2026-03-28 12:08:23 [auto1.it] INFO: Scrape type for HD78178: 0
2026-03-28 12:08:23 [auto1.it] INFO: Found listing with ID: DE32338
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE32338%27 HTTP/1.1" 200 None
2026-03-28 12:08:23 [auto1.it] INFO: Scrape type for DE32338: 0
2026-03-28 12:08:23 [auto1.it] INFO: Found listing with ID: AK32072
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK32072%27 HTTP/1.1" 200 None
2026-03-28 12:08:23 [auto1.it] INFO: Scrape type for AK32072: 0
2026-03-28 12:08:23 [auto1.it] INFO: Found listing with ID: AB09853
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB09853%27 HTTP/1.1" 200 None
2026-03-28 12:08:23 [auto1.it] INFO: Scrape type for AB09853: 0
2026-03-28 12:08:23 [auto1.it] INFO: Found listing with ID: PS40086
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PS40086%27 HTTP/1.1" 200 None
2026-03-28 12:08:23 [auto1.it] INFO: Scrape type for PS40086: 0
2026-03-28 12:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:08:24 [auto1.it] INFO: Channel: 24h | Page: 36 | totalHits: 3675 | hits on page: 40
2026-03-28 12:08:24 [auto1.it] INFO: Found listing with ID: XJ23148
2026-03-28 12:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ23148%27 HTTP/1.1" 200 None
2026-03-28 12:08:24 [auto1.it] INFO: Scrape type for XJ23148: 0
2026-03-28 12:08:24 [auto1.it] INFO: Found listing with ID: FX22483
2026-03-28 12:08:24 [auto1.it] INFO: Found listing with ID: BY60716
2026-03-28 12:08:24 [auto1.it] INFO: Found listing with ID: JR58034
2026-03-28 12:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR58034%27 HTTP/1.1" 200 None
2026-03-28 12:08:24 [auto1.it] INFO: Scrape type for JR58034: 0
2026-03-28 12:08:24 [auto1.it] INFO: Found listing with ID: AE43427
2026-03-28 12:08:24 [auto1.it] INFO: Found listing with ID: RU31162
2026-03-28 12:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU31162%27 HTTP/1.1" 200 None
2026-03-28 12:08:24 [auto1.it] INFO: Scrape type for RU31162: 2
2026-03-28 12:08:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 694b13bc-ca98-5899-8dc5-1707210df401 with identifier: RU31162
2026-03-28 12:08:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 694b13bc-ca98-5899-8dc5-1707210df401 with scrape type 2
2026-03-28 12:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 694b13bc-ca98-5899-8dc5-1707210df401 with scrape type 2
2026-03-28 12:08:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 694b13bc-ca98-5899-8dc5-1707210df401, identifier: RU31162
2026-03-28 12:08:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 694b13bc-ca98-5899-8dc5-1707210df401 with identifier: RU31162
2026-03-28 12:08:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 694b13bc-ca98-5899-8dc5-1707210df401 with identifier: RU31162
2026-03-28 12:08:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 694b13bc-ca98-5899-8dc5-1707210df401 with identifier: RU31162 to the API
2026-03-28 12:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:50:42Z',
 'fuel_type': 'petrol',
 'id': '694b13bc-ca98-5899-8dc5-1707210df401',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU31162',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Avenger',
 'odometer': 24342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-25',
 'seller_name': None,
 'title': 'Jeep Avenger 1.2 T-GDI Longitude',
 'transmission': 'manual',
 'trim': 'Longitude',
 'year': 2023}
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU31162%27 HTTP/1.1" 200 None
2026-03-28 12:08:25 [auto1.it] INFO: Saving data for RU31162: {'auction_closing_time': 1774716642.0, 'created_time': 1774515999.662192, 'last_price_update_time': 1774699705.188842}
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RU31162') HTTP/1.1" 204 0
2026-03-28 12:08:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:08:25 [auto1.it] INFO: Found listing with ID: VS39586
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS39586%27 HTTP/1.1" 200 None
2026-03-28 12:08:25 [auto1.it] INFO: Scrape type for VS39586: 2
2026-03-28 12:08:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ff992e1-1dc0-5779-a68e-74d7e84242ec with identifier: VS39586
2026-03-28 12:08:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ff992e1-1dc0-5779-a68e-74d7e84242ec with scrape type 2
2026-03-28 12:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ff992e1-1dc0-5779-a68e-74d7e84242ec with scrape type 2
2026-03-28 12:08:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5ff992e1-1dc0-5779-a68e-74d7e84242ec, identifier: VS39586
2026-03-28 12:08:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5ff992e1-1dc0-5779-a68e-74d7e84242ec with identifier: VS39586
2026-03-28 12:08:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5ff992e1-1dc0-5779-a68e-74d7e84242ec with identifier: VS39586
2026-03-28 12:08:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5ff992e1-1dc0-5779-a68e-74d7e84242ec with identifier: VS39586 to the API
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:30:56Z',
 'fuel_type': 'diesel',
 'id': '5ff992e1-1dc0-5779-a68e-74d7e84242ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS39586',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 177867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-27',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D2 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2015}
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS39586%27 HTTP/1.1" 200 None
2026-03-28 12:08:25 [auto1.it] INFO: Saving data for VS39586: {'auction_closing_time': 1774715456.0, 'created_time': 1774101945.165721, 'last_price_update_time': 1774699705.747259}
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VS39586') HTTP/1.1" 204 0
2026-03-28 12:08:25 [auto1.it] INFO: Found listing with ID: EA47428
2026-03-28 12:08:25 [auto1.it] INFO: Found listing with ID: WB86834
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB86834%27 HTTP/1.1" 200 None
2026-03-28 12:08:25 [auto1.it] INFO: Scrape type for WB86834: 0
2026-03-28 12:08:25 [auto1.it] INFO: Found listing with ID: NL88332
2026-03-28 12:08:25 [auto1.it] INFO: Found listing with ID: EW60341
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW60341%27 HTTP/1.1" 200 None
2026-03-28 12:08:25 [auto1.it] INFO: Scrape type for EW60341: 0
2026-03-28 12:08:25 [auto1.it] INFO: Found listing with ID: HG53110
2026-03-28 12:08:25 [auto1.it] INFO: Found listing with ID: XD73151
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD73151%27 HTTP/1.1" 200 None
2026-03-28 12:08:25 [auto1.it] INFO: Scrape type for XD73151: 0
2026-03-28 12:08:25 [auto1.it] INFO: Found listing with ID: PE73293
2026-03-28 12:08:25 [auto1.it] INFO: Found listing with ID: AN97971
2026-03-28 12:08:25 [auto1.it] INFO: Found listing with ID: RN28798
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN28798%27 HTTP/1.1" 200 None
2026-03-28 12:08:25 [auto1.it] INFO: Scrape type for RN28798: 0
2026-03-28 12:08:25 [auto1.it] INFO: Found listing with ID: XR36551
2026-03-28 12:08:25 [auto1.it] INFO: Found listing with ID: ZX52658
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX52658%27 HTTP/1.1" 200 None
2026-03-28 12:08:25 [auto1.it] INFO: Scrape type for ZX52658: 0
2026-03-28 12:08:25 [auto1.it] INFO: Found listing with ID: GT17675
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT17675%27 HTTP/1.1" 200 None
2026-03-28 12:08:25 [auto1.it] INFO: Scrape type for GT17675: 0
2026-03-28 12:08:25 [auto1.it] INFO: Found listing with ID: DN72005
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN72005%27 HTTP/1.1" 200 None
2026-03-28 12:08:25 [auto1.it] INFO: Scrape type for DN72005: 0
2026-03-28 12:08:25 [auto1.it] INFO: Found listing with ID: UJ09788
2026-03-28 12:08:25 [auto1.it] INFO: Found listing with ID: RF11851
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF11851%27 HTTP/1.1" 200 None
2026-03-28 12:08:25 [auto1.it] INFO: Scrape type for RF11851: 0
2026-03-28 12:08:25 [auto1.it] INFO: Found listing with ID: MG39360
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG39360%27 HTTP/1.1" 200 None
2026-03-28 12:08:25 [auto1.it] INFO: Scrape type for MG39360: 0
2026-03-28 12:08:25 [auto1.it] INFO: Found listing with ID: UR73173
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR73173%27 HTTP/1.1" 200 None
2026-03-28 12:08:25 [auto1.it] INFO: Scrape type for UR73173: 0
2026-03-28 12:08:25 [auto1.it] INFO: Found listing with ID: SY30215
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY30215%27 HTTP/1.1" 200 None
2026-03-28 12:08:25 [auto1.it] INFO: Scrape type for SY30215: 0
2026-03-28 12:08:25 [auto1.it] INFO: Found listing with ID: XR70694
2026-03-28 12:08:25 [auto1.it] INFO: Found listing with ID: YM70173
2026-03-28 12:08:25 [auto1.it] INFO: Found listing with ID: VE91156
2026-03-28 12:08:25 [auto1.it] INFO: Found listing with ID: GS51961
2026-03-28 12:08:25 [auto1.it] INFO: Found listing with ID: JP32854
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP32854%27 HTTP/1.1" 200 None
2026-03-28 12:08:25 [auto1.it] INFO: Scrape type for JP32854: 0
2026-03-28 12:08:25 [auto1.it] INFO: Found listing with ID: BR14904
2026-03-28 12:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR14904%27 HTTP/1.1" 200 None
2026-03-28 12:08:26 [auto1.it] INFO: Scrape type for BR14904: 0
2026-03-28 12:08:26 [auto1.it] INFO: Found listing with ID: DN82434
2026-03-28 12:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN82434%27 HTTP/1.1" 200 None
2026-03-28 12:08:26 [auto1.it] INFO: Scrape type for DN82434: 2
2026-03-28 12:08:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 204b6b1e-fd27-5062-9287-6bb219e7fc47 with identifier: DN82434
2026-03-28 12:08:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 204b6b1e-fd27-5062-9287-6bb219e7fc47 with scrape type 2
2026-03-28 12:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 204b6b1e-fd27-5062-9287-6bb219e7fc47 with scrape type 2
2026-03-28 12:08:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 204b6b1e-fd27-5062-9287-6bb219e7fc47, identifier: DN82434
2026-03-28 12:08:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 204b6b1e-fd27-5062-9287-6bb219e7fc47 with identifier: DN82434
2026-03-28 12:08:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 204b6b1e-fd27-5062-9287-6bb219e7fc47 with identifier: DN82434
2026-03-28 12:08:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 204b6b1e-fd27-5062-9287-6bb219e7fc47 with identifier: DN82434 to the API
2026-03-28 12:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:55:04Z',
 'fuel_type': 'diesel',
 'id': '204b6b1e-fd27-5062-9287-6bb219e7fc47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN82434',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia',
 'odometer': 149100,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-17',
 'seller_name': None,
 'title': 'Opel Insignia 2.0 CDTI Cosmo',
 'transmission': 'automatic',
 'trim': 'Cosmo',
 'year': 2012}
2026-03-28 12:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN82434%27 HTTP/1.1" 200 None
2026-03-28 12:08:26 [auto1.it] INFO: Saving data for DN82434: {'auction_closing_time': 1774716904.0, 'created_time': 1774516032.447894, 'last_price_update_time': 1774699706.453571}
2026-03-28 12:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DN82434') HTTP/1.1" 204 0
2026-03-28 12:08:26 [auto1.it] INFO: Found listing with ID: LH79871
2026-03-28 12:08:26 [auto1.it] INFO: Found listing with ID: AA53692
2026-03-28 12:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AA53692%27 HTTP/1.1" 200 None
2026-03-28 12:08:26 [auto1.it] INFO: Scrape type for AA53692: 0
2026-03-28 12:08:26 [auto1.it] INFO: Found listing with ID: XU52863
2026-03-28 12:08:26 [auto1.it] INFO: Found listing with ID: XE42433
2026-03-28 12:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE42433%27 HTTP/1.1" 200 None
2026-03-28 12:08:26 [auto1.it] INFO: Scrape type for XE42433: 0
2026-03-28 12:08:26 [auto1.it] INFO: Found listing with ID: GZ15334
2026-03-28 12:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ15334%27 HTTP/1.1" 200 None
2026-03-28 12:08:26 [auto1.it] INFO: Scrape type for GZ15334: 0
2026-03-28 12:08:26 [auto1.it] INFO: Found listing with ID: WJ00117
2026-03-28 12:08:26 [auto1.it] INFO: Found listing with ID: GM47184
2026-03-28 12:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM47184%27 HTTP/1.1" 200 None
2026-03-28 12:08:26 [auto1.it] INFO: Scrape type for GM47184: 0
2026-03-28 12:08:26 [auto1.it] INFO: Found listing with ID: KY15246
2026-03-28 12:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KY15246%27 HTTP/1.1" 200 None
2026-03-28 12:08:26 [auto1.it] INFO: Scrape type for KY15246: 0
2026-03-28 12:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:08:27 [auto1.it] INFO: Channel: 24h | Page: 37 | totalHits: 3675 | hits on page: 40
2026-03-28 12:08:27 [auto1.it] INFO: Found listing with ID: FX38353
2026-03-28 12:08:27 [auto1.it] INFO: Found listing with ID: JM07675
2026-03-28 12:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM07675%27 HTTP/1.1" 200 None
2026-03-28 12:08:27 [auto1.it] INFO: Scrape type for JM07675: 0
2026-03-28 12:08:27 [auto1.it] INFO: Found listing with ID: NF63759
2026-03-28 12:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF63759%27 HTTP/1.1" 200 None
2026-03-28 12:08:27 [auto1.it] INFO: Scrape type for NF63759: 0
2026-03-28 12:08:27 [auto1.it] INFO: Found listing with ID: BF97905
2026-03-28 12:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF97905%27 HTTP/1.1" 200 None
2026-03-28 12:08:27 [auto1.it] INFO: Scrape type for BF97905: 0
2026-03-28 12:08:27 [auto1.it] INFO: Found listing with ID: YW01927
2026-03-28 12:08:27 [auto1.it] INFO: Found listing with ID: RV18634
2026-03-28 12:08:27 [auto1.it] INFO: Found listing with ID: RP22465
2026-03-28 12:08:27 [auto1.it] INFO: Found listing with ID: MD04022
2026-03-28 12:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD04022%27 HTTP/1.1" 200 None
2026-03-28 12:08:27 [auto1.it] INFO: Scrape type for MD04022: 0
2026-03-28 12:08:27 [auto1.it] INFO: Found listing with ID: RL85068
2026-03-28 12:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL85068%27 HTTP/1.1" 200 None
2026-03-28 12:08:27 [auto1.it] INFO: Scrape type for RL85068: 0
2026-03-28 12:08:27 [auto1.it] INFO: Found listing with ID: UN95232
2026-03-28 12:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN95232%27 HTTP/1.1" 200 None
2026-03-28 12:08:27 [auto1.it] INFO: Scrape type for UN95232: 0
2026-03-28 12:08:27 [auto1.it] INFO: Found listing with ID: GM12910
2026-03-28 12:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM12910%27 HTTP/1.1" 200 None
2026-03-28 12:08:27 [auto1.it] INFO: Scrape type for GM12910: 0
2026-03-28 12:08:27 [auto1.it] INFO: Found listing with ID: UM01016
2026-03-28 12:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM01016%27 HTTP/1.1" 200 None
2026-03-28 12:08:27 [auto1.it] INFO: Scrape type for UM01016: 0
2026-03-28 12:08:27 [auto1.it] INFO: Found listing with ID: AK10390
2026-03-28 12:08:27 [auto1.it] INFO: Found listing with ID: FU92743
2026-03-28 12:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU92743%27 HTTP/1.1" 200 None
2026-03-28 12:08:27 [auto1.it] INFO: Scrape type for FU92743: 2
2026-03-28 12:08:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdb075df-a6bf-5144-bdaf-7cbc5f0f216c with identifier: FU92743
2026-03-28 12:08:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdb075df-a6bf-5144-bdaf-7cbc5f0f216c with scrape type 2
2026-03-28 12:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdb075df-a6bf-5144-bdaf-7cbc5f0f216c with scrape type 2
2026-03-28 12:08:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cdb075df-a6bf-5144-bdaf-7cbc5f0f216c, identifier: FU92743
2026-03-28 12:08:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cdb075df-a6bf-5144-bdaf-7cbc5f0f216c with identifier: FU92743
2026-03-28 12:08:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cdb075df-a6bf-5144-bdaf-7cbc5f0f216c with identifier: FU92743
2026-03-28 12:08:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cdb075df-a6bf-5144-bdaf-7cbc5f0f216c with identifier: FU92743 to the API
2026-03-28 12:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:44:36Z',
 'fuel_type': 'diesel',
 'id': 'cdb075df-a6bf-5144-bdaf-7cbc5f0f216c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU92743',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 171153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-25',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI Innovation Start/Stop',
 'transmission': 'manual',
 'trim': 'Innovation Start/Stop',
 'year': 2017}
2026-03-28 12:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU92743%27 HTTP/1.1" 200 None
2026-03-28 12:08:28 [auto1.it] INFO: Saving data for FU92743: {'auction_closing_time': 1774716276.0, 'created_time': 1774516025.025714, 'last_price_update_time': 1774699708.083853}
2026-03-28 12:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FU92743') HTTP/1.1" 204 0
2026-03-28 12:08:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:08:28 [auto1.it] INFO: Found listing with ID: VM43481
2026-03-28 12:08:28 [auto1.it] INFO: Found listing with ID: NY79703
2026-03-28 12:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY79703%27 HTTP/1.1" 200 None
2026-03-28 12:08:28 [auto1.it] INFO: Scrape type for NY79703: 0
2026-03-28 12:08:28 [auto1.it] INFO: Found listing with ID: ZR63557
2026-03-28 12:08:28 [auto1.it] INFO: Found listing with ID: YN42952
2026-03-28 12:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YN42952%27 HTTP/1.1" 200 None
2026-03-28 12:08:28 [auto1.it] INFO: Scrape type for YN42952: 0
2026-03-28 12:08:28 [auto1.it] INFO: Found listing with ID: PD49568
2026-03-28 12:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD49568%27 HTTP/1.1" 200 None
2026-03-28 12:08:28 [auto1.it] INFO: Scrape type for PD49568: 0
2026-03-28 12:08:28 [auto1.it] INFO: Found listing with ID: WM56040
2026-03-28 12:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM56040%27 HTTP/1.1" 200 None
2026-03-28 12:08:28 [auto1.it] INFO: Scrape type for WM56040: 0
2026-03-28 12:08:28 [auto1.it] INFO: Found listing with ID: TW09366
2026-03-28 12:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW09366%27 HTTP/1.1" 200 None
2026-03-28 12:08:28 [auto1.it] INFO: Scrape type for TW09366: 0
2026-03-28 12:08:28 [auto1.it] INFO: Found listing with ID: PJ86967
2026-03-28 12:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PJ86967%27 HTTP/1.1" 200 None
2026-03-28 12:08:28 [auto1.it] INFO: Scrape type for PJ86967: 0
2026-03-28 12:08:28 [auto1.it] INFO: Found listing with ID: LC98621
2026-03-28 12:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC98621%27 HTTP/1.1" 200 None
2026-03-28 12:08:28 [auto1.it] INFO: Scrape type for LC98621: 0
2026-03-28 12:08:28 [auto1.it] INFO: Found listing with ID: WT33776
2026-03-28 12:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WT33776%27 HTTP/1.1" 200 None
2026-03-28 12:08:28 [auto1.it] INFO: Scrape type for WT33776: 0
2026-03-28 12:08:28 [auto1.it] INFO: Found listing with ID: CZ68446
2026-03-28 12:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ68446%27 HTTP/1.1" 200 None
2026-03-28 12:08:28 [auto1.it] INFO: Scrape type for CZ68446: 0
2026-03-28 12:08:28 [auto1.it] INFO: Found listing with ID: BK05178
2026-03-28 12:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BK05178%27 HTTP/1.1" 200 None
2026-03-28 12:08:28 [auto1.it] INFO: Scrape type for BK05178: 0
2026-03-28 12:08:28 [auto1.it] INFO: Found listing with ID: GA57810
2026-03-28 12:08:28 [auto1.it] INFO: Found listing with ID: JV05733
2026-03-28 12:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV05733%27 HTTP/1.1" 200 None
2026-03-28 12:08:28 [auto1.it] INFO: Scrape type for JV05733: 2
2026-03-28 12:08:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f2b6885-4f87-5d8b-aac1-2e53e4432d3f with identifier: JV05733
2026-03-28 12:08:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f2b6885-4f87-5d8b-aac1-2e53e4432d3f with scrape type 2
2026-03-28 12:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f2b6885-4f87-5d8b-aac1-2e53e4432d3f with scrape type 2
2026-03-28 12:08:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6f2b6885-4f87-5d8b-aac1-2e53e4432d3f, identifier: JV05733
2026-03-28 12:08:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6f2b6885-4f87-5d8b-aac1-2e53e4432d3f with identifier: JV05733
2026-03-28 12:08:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6f2b6885-4f87-5d8b-aac1-2e53e4432d3f with identifier: JV05733
2026-03-28 12:08:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6f2b6885-4f87-5d8b-aac1-2e53e4432d3f with identifier: JV05733 to the API
2026-03-28 12:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:55:22Z',
 'fuel_type': 'diesel',
 'id': '6f2b6885-4f87-5d8b-aac1-2e53e4432d3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV05733',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 159985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-28',
 'seller_name': None,
 'title': 'Dacia Sandero 1.5 dCi Laureate Family',
 'transmission': 'manual',
 'trim': 'Laureate Family',
 'year': 2016}
2026-03-28 12:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV05733%27 HTTP/1.1" 200 None
2026-03-28 12:08:28 [auto1.it] INFO: Saving data for JV05733: {'auction_closing_time': 1774716922.0, 'created_time': 1774516046.05099, 'last_price_update_time': 1774699708.90365}
2026-03-28 12:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JV05733') HTTP/1.1" 204 0
2026-03-28 12:08:29 [auto1.it] INFO: Found listing with ID: MZ19905
2026-03-28 12:08:29 [auto1.it] INFO: Found listing with ID: EG69855
2026-03-28 12:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG69855%27 HTTP/1.1" 200 None
2026-03-28 12:08:29 [auto1.it] INFO: Scrape type for EG69855: 0
2026-03-28 12:08:29 [auto1.it] INFO: Found listing with ID: NX71377
2026-03-28 12:08:29 [auto1.it] INFO: Found listing with ID: MB21840
2026-03-28 12:08:29 [auto1.it] INFO: Found listing with ID: KF04407
2026-03-28 12:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF04407%27 HTTP/1.1" 200 None
2026-03-28 12:08:29 [auto1.it] INFO: Scrape type for KF04407: 0
2026-03-28 12:08:29 [auto1.it] INFO: Found listing with ID: NB08226
2026-03-28 12:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB08226%27 HTTP/1.1" 200 None
2026-03-28 12:08:29 [auto1.it] INFO: Scrape type for NB08226: 2
2026-03-28 12:08:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbdd80f4-5df5-5717-8a52-d6342a8e8550 with identifier: NB08226
2026-03-28 12:08:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbdd80f4-5df5-5717-8a52-d6342a8e8550 with scrape type 2
2026-03-28 12:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbdd80f4-5df5-5717-8a52-d6342a8e8550 with scrape type 2
2026-03-28 12:08:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fbdd80f4-5df5-5717-8a52-d6342a8e8550, identifier: NB08226
2026-03-28 12:08:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fbdd80f4-5df5-5717-8a52-d6342a8e8550 with identifier: NB08226
2026-03-28 12:08:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fbdd80f4-5df5-5717-8a52-d6342a8e8550 with identifier: NB08226
2026-03-28 12:08:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fbdd80f4-5df5-5717-8a52-d6342a8e8550 with identifier: NB08226 to the API
2026-03-28 12:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:45:43Z',
 'fuel_type': 'diesel',
 'id': 'fbdd80f4-5df5-5717-8a52-d6342a8e8550',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB08226',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 296486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-27',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2011}
2026-03-28 12:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB08226%27 HTTP/1.1" 200 None
2026-03-28 12:08:29 [auto1.it] INFO: Saving data for NB08226: {'auction_closing_time': 1774716343.0, 'created_time': 1772143086.250676, 'last_price_update_time': 1774699709.458987}
2026-03-28 12:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NB08226') HTTP/1.1" 204 0
2026-03-28 12:08:29 [auto1.it] INFO: Found listing with ID: WJ13439
2026-03-28 12:08:29 [auto1.it] INFO: Found listing with ID: VF45343
2026-03-28 12:08:29 [auto1.it] INFO: Found listing with ID: VD09142
2026-03-28 12:08:29 [auto1.it] INFO: Found listing with ID: GG79286
2026-03-28 12:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GG79286%27 HTTP/1.1" 200 None
2026-03-28 12:08:29 [auto1.it] INFO: Scrape type for GG79286: 2
2026-03-28 12:08:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dab62c0-e59e-50f1-9ee0-991ed1a4a8fc with identifier: GG79286
2026-03-28 12:08:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dab62c0-e59e-50f1-9ee0-991ed1a4a8fc with scrape type 2
2026-03-28 12:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2dab62c0-e59e-50f1-9ee0-991ed1a4a8fc with scrape type 2
2026-03-28 12:08:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2dab62c0-e59e-50f1-9ee0-991ed1a4a8fc, identifier: GG79286
2026-03-28 12:08:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2dab62c0-e59e-50f1-9ee0-991ed1a4a8fc with identifier: GG79286
2026-03-28 12:08:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2dab62c0-e59e-50f1-9ee0-991ed1a4a8fc with identifier: GG79286
2026-03-28 12:08:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2dab62c0-e59e-50f1-9ee0-991ed1a4a8fc with identifier: GG79286 to the API
2026-03-28 12:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-28T16:15:52Z',
 'fuel_type': 'gas',
 'id': '2dab62c0-e59e-50f1-9ee0-991ed1a4a8fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG79286',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 148294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-09',
 'seller_name': None,
 'title': 'Opel Adam 1.4 Jam ecoFlex',
 'transmission': 'manual',
 'trim': 'Jam ecoFlex',
 'year': 2016}
2026-03-28 12:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GG79286%27 HTTP/1.1" 200 None
2026-03-28 12:08:29 [auto1.it] INFO: Saving data for GG79286: {'auction_closing_time': 1774714552.0, 'created_time': 1774101974.256659, 'last_price_update_time': 1774699709.903959}
2026-03-28 12:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GG79286') HTTP/1.1" 204 0
2026-03-28 12:08:29 [auto1.it] INFO: Found listing with ID: LE05558
2026-03-28 12:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE05558%27 HTTP/1.1" 200 None
2026-03-28 12:08:29 [auto1.it] INFO: Scrape type for LE05558: 0
2026-03-28 12:08:29 [auto1.it] INFO: Found listing with ID: DJ62312
2026-03-28 12:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ62312%27 HTTP/1.1" 200 None
2026-03-28 12:08:29 [auto1.it] INFO: Scrape type for DJ62312: 0
2026-03-28 12:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:08:30 [auto1.it] INFO: Channel: 24h | Page: 38 | totalHits: 3675 | hits on page: 40
2026-03-28 12:08:30 [auto1.it] INFO: Found listing with ID: AG53064
2026-03-28 12:08:30 [auto1.it] INFO: Found listing with ID: DH05313
2026-03-28 12:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DH05313%27 HTTP/1.1" 200 None
2026-03-28 12:08:30 [auto1.it] INFO: Scrape type for DH05313: 0
2026-03-28 12:08:30 [auto1.it] INFO: Found listing with ID: VC28315
2026-03-28 12:08:30 [auto1.it] INFO: Found listing with ID: NC89315
2026-03-28 12:08:30 [auto1.it] INFO: Found listing with ID: NU69507
2026-03-28 12:08:30 [auto1.it] INFO: Found listing with ID: AE94250
2026-03-28 12:08:30 [auto1.it] INFO: Found listing with ID: ZR59714
2026-03-28 12:08:30 [auto1.it] INFO: Found listing with ID: WH67048
2026-03-28 12:08:30 [auto1.it] INFO: Found listing with ID: JH32473
2026-03-28 12:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH32473%27 HTTP/1.1" 200 None
2026-03-28 12:08:30 [auto1.it] INFO: Scrape type for JH32473: 0
2026-03-28 12:08:30 [auto1.it] INFO: Found listing with ID: CV59380
2026-03-28 12:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV59380%27 HTTP/1.1" 200 None
2026-03-28 12:08:30 [auto1.it] INFO: Scrape type for CV59380: 0
2026-03-28 12:08:30 [auto1.it] INFO: Found listing with ID: RK20934
2026-03-28 12:08:30 [auto1.it] INFO: Found listing with ID: NC77921
2026-03-28 12:08:30 [auto1.it] INFO: Found listing with ID: YE04007
2026-03-28 12:08:30 [auto1.it] INFO: Found listing with ID: NT79390
2026-03-28 12:08:30 [auto1.it] INFO: Found listing with ID: FP22884
2026-03-28 12:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP22884%27 HTTP/1.1" 200 None
2026-03-28 12:08:30 [auto1.it] INFO: Scrape type for FP22884: 0
2026-03-28 12:08:30 [auto1.it] INFO: Found listing with ID: ZV86353
2026-03-28 12:08:30 [auto1.it] INFO: Found listing with ID: LW86273
2026-03-28 12:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW86273%27 HTTP/1.1" 200 None
2026-03-28 12:08:30 [auto1.it] INFO: Scrape type for LW86273: 0
2026-03-28 12:08:30 [auto1.it] INFO: Found listing with ID: FG09627
2026-03-28 12:08:30 [auto1.it] INFO: Found listing with ID: BG42211
2026-03-28 12:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG42211%27 HTTP/1.1" 200 None
2026-03-28 12:08:30 [auto1.it] INFO: Scrape type for BG42211: 0
2026-03-28 12:08:30 [auto1.it] INFO: Found listing with ID: XB60526
2026-03-28 12:08:30 [auto1.it] INFO: Found listing with ID: JS97263
2026-03-28 12:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS97263%27 HTTP/1.1" 200 None
2026-03-28 12:08:30 [auto1.it] INFO: Scrape type for JS97263: 0
2026-03-28 12:08:30 [auto1.it] INFO: Found listing with ID: FX24983
2026-03-28 12:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX24983%27 HTTP/1.1" 200 None
2026-03-28 12:08:30 [auto1.it] INFO: Scrape type for FX24983: 0
2026-03-28 12:08:30 [auto1.it] INFO: Found listing with ID: VU11306
2026-03-28 12:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU11306%27 HTTP/1.1" 200 None
2026-03-28 12:08:31 [auto1.it] INFO: Scrape type for VU11306: 2
2026-03-28 12:08:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f63aa52-5478-5916-a792-fee666dd086b with identifier: VU11306
2026-03-28 12:08:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f63aa52-5478-5916-a792-fee666dd086b with scrape type 2
2026-03-28 12:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f63aa52-5478-5916-a792-fee666dd086b with scrape type 2
2026-03-28 12:08:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3f63aa52-5478-5916-a792-fee666dd086b, identifier: VU11306
2026-03-28 12:08:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3f63aa52-5478-5916-a792-fee666dd086b with identifier: VU11306
2026-03-28 12:08:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3f63aa52-5478-5916-a792-fee666dd086b with identifier: VU11306
2026-03-28 12:08:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3f63aa52-5478-5916-a792-fee666dd086b with identifier: VU11306 to the API
2026-03-28 12:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:48:02Z',
 'fuel_type': 'diesel',
 'id': '3f63aa52-5478-5916-a792-fee666dd086b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU11306',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 112043,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-31',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.6 JTDM Distinctive',
 'transmission': 'manual',
 'trim': 'Distinctive',
 'year': 2013}
2026-03-28 12:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU11306%27 HTTP/1.1" 200 None
2026-03-28 12:08:31 [auto1.it] INFO: Saving data for VU11306: {'auction_closing_time': 1774716482.0, 'created_time': 1774127140.808651, 'last_price_update_time': 1774699711.703764}
2026-03-28 12:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VU11306') HTTP/1.1" 204 0
2026-03-28 12:08:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:08:31 [auto1.it] INFO: Found listing with ID: WH96118
2026-03-28 12:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH96118%27 HTTP/1.1" 200 None
2026-03-28 12:08:31 [auto1.it] INFO: Scrape type for WH96118: 0
2026-03-28 12:08:31 [auto1.it] INFO: Found listing with ID: DB15291
2026-03-28 12:08:31 [auto1.it] INFO: Found listing with ID: CG32909
2026-03-28 12:08:31 [auto1.it] INFO: Found listing with ID: FE11339
2026-03-28 12:08:31 [auto1.it] INFO: Found listing with ID: KY33943
2026-03-28 12:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KY33943%27 HTTP/1.1" 200 None
2026-03-28 12:08:31 [auto1.it] INFO: Scrape type for KY33943: 2
2026-03-28 12:08:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c05a97f-0ac4-5adf-8b7e-648c01e4a5a3 with identifier: KY33943
2026-03-28 12:08:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c05a97f-0ac4-5adf-8b7e-648c01e4a5a3 with scrape type 2
2026-03-28 12:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c05a97f-0ac4-5adf-8b7e-648c01e4a5a3 with scrape type 2
2026-03-28 12:08:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2c05a97f-0ac4-5adf-8b7e-648c01e4a5a3, identifier: KY33943
2026-03-28 12:08:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2c05a97f-0ac4-5adf-8b7e-648c01e4a5a3 with identifier: KY33943
2026-03-28 12:08:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2c05a97f-0ac4-5adf-8b7e-648c01e4a5a3 with identifier: KY33943
2026-03-28 12:08:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2c05a97f-0ac4-5adf-8b7e-648c01e4a5a3 with identifier: KY33943 to the API
2026-03-28 12:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:32:17Z',
 'fuel_type': 'diesel',
 'id': '2c05a97f-0ac4-5adf-8b7e-648c01e4a5a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY33943',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 66060,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-08',
 'seller_name': None,
 'title': 'Fiat Tipo 1.6 JTDM Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2020}
2026-03-28 12:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KY33943%27 HTTP/1.1" 200 None
2026-03-28 12:08:32 [auto1.it] INFO: Saving data for KY33943: {'auction_closing_time': 1774715537.0, 'created_time': 1774516047.000903, 'last_price_update_time': 1774699712.506004}
2026-03-28 12:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KY33943') HTTP/1.1" 204 0
2026-03-28 12:08:32 [auto1.it] INFO: Found listing with ID: RY92911
2026-03-28 12:08:32 [auto1.it] INFO: Found listing with ID: CR43850
2026-03-28 12:08:32 [auto1.it] INFO: Found listing with ID: YM64414
2026-03-28 12:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM64414%27 HTTP/1.1" 200 None
2026-03-28 12:08:32 [auto1.it] INFO: Scrape type for YM64414: 2
2026-03-28 12:08:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c071068-58a1-5413-bfc3-a09cf1d97058 with identifier: YM64414
2026-03-28 12:08:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c071068-58a1-5413-bfc3-a09cf1d97058 with scrape type 2
2026-03-28 12:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c071068-58a1-5413-bfc3-a09cf1d97058 with scrape type 2
2026-03-28 12:08:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7c071068-58a1-5413-bfc3-a09cf1d97058, identifier: YM64414
2026-03-28 12:08:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7c071068-58a1-5413-bfc3-a09cf1d97058 with identifier: YM64414
2026-03-28 12:08:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7c071068-58a1-5413-bfc3-a09cf1d97058 with identifier: YM64414
2026-03-28 12:08:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7c071068-58a1-5413-bfc3-a09cf1d97058 with identifier: YM64414 to the API
2026-03-28 12:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:25:00Z',
 'fuel_type': 'diesel',
 'id': '7c071068-58a1-5413-bfc3-a09cf1d97058',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM64414',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 66287,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-17',
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBlue TDCi Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2020}
2026-03-28 12:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM64414%27 HTTP/1.1" 200 None
2026-03-28 12:08:32 [auto1.it] INFO: Saving data for YM64414: {'auction_closing_time': 1774715100.0, 'created_time': 1774516004.443404, 'last_price_update_time': 1774699712.944673}
2026-03-28 12:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YM64414') HTTP/1.1" 204 0
2026-03-28 12:08:32 [auto1.it] INFO: Found listing with ID: VW82283
2026-03-28 12:08:32 [auto1.it] INFO: Found listing with ID: LN22753
2026-03-28 12:08:32 [auto1.it] INFO: Found listing with ID: MH41109
2026-03-28 12:08:32 [auto1.it] INFO: Found listing with ID: VH13695
2026-03-28 12:08:32 [auto1.it] INFO: Found listing with ID: UJ01358
2026-03-28 12:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UJ01358%27 HTTP/1.1" 200 None
2026-03-28 12:08:32 [auto1.it] INFO: Scrape type for UJ01358: 0
2026-03-28 12:08:32 [auto1.it] INFO: Found listing with ID: NT98508
2026-03-28 12:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT98508%27 HTTP/1.1" 200 None
2026-03-28 12:08:32 [auto1.it] INFO: Scrape type for NT98508: 0
2026-03-28 12:08:32 [auto1.it] INFO: Found listing with ID: CW72749
2026-03-28 12:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW72749%27 HTTP/1.1" 200 None
2026-03-28 12:08:33 [auto1.it] INFO: Scrape type for CW72749: 0
2026-03-28 12:08:33 [auto1.it] INFO: Found listing with ID: SP39094
2026-03-28 12:08:33 [auto1.it] INFO: Found listing with ID: TZ83605
2026-03-28 12:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ83605%27 HTTP/1.1" 200 None
2026-03-28 12:08:33 [auto1.it] INFO: Scrape type for TZ83605: 0
2026-03-28 12:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:08:33 [auto1.it] INFO: Channel: 24h | Page: 39 | totalHits: 3675 | hits on page: 40
2026-03-28 12:08:33 [auto1.it] INFO: Found listing with ID: NJ78354
2026-03-28 12:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NJ78354%27 HTTP/1.1" 200 None
2026-03-28 12:08:33 [auto1.it] INFO: Scrape type for NJ78354: 0
2026-03-28 12:08:33 [auto1.it] INFO: Found listing with ID: KU06425
2026-03-28 12:08:33 [auto1.it] INFO: Found listing with ID: VC06734
2026-03-28 12:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC06734%27 HTTP/1.1" 200 None
2026-03-28 12:08:33 [auto1.it] INFO: Scrape type for VC06734: 2
2026-03-28 12:08:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d42e3af6-bbcb-5888-9308-b123501aa994 with identifier: VC06734
2026-03-28 12:08:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d42e3af6-bbcb-5888-9308-b123501aa994 with scrape type 2
2026-03-28 12:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d42e3af6-bbcb-5888-9308-b123501aa994 with scrape type 2
2026-03-28 12:08:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d42e3af6-bbcb-5888-9308-b123501aa994, identifier: VC06734
2026-03-28 12:08:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d42e3af6-bbcb-5888-9308-b123501aa994 with identifier: VC06734
2026-03-28 12:08:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d42e3af6-bbcb-5888-9308-b123501aa994 with identifier: VC06734
2026-03-28 12:08:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d42e3af6-bbcb-5888-9308-b123501aa994 with identifier: VC06734 to the API
2026-03-28 12:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 88,
 'expiration_date': '2026-03-28T16:17:34Z',
 'fuel_type': 'diesel',
 'id': 'd42e3af6-bbcb-5888-9308-b123501aa994',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC06734',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 330000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-20',
 'seller_name': None,
 'title': 'Dacia Sandero 1.5 dCi Stepway',
 'transmission': 'manual',
 'trim': 'Stepway',
 'year': 2011}
2026-03-28 12:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC06734%27 HTTP/1.1" 200 None
2026-03-28 12:08:34 [auto1.it] INFO: Saving data for VC06734: {'auction_closing_time': 1774714654.0, 'created_time': 1774516047.366109, 'last_price_update_time': 1774699714.248719}
2026-03-28 12:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VC06734') HTTP/1.1" 204 0
2026-03-28 12:08:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:08:34 [auto1.it] INFO: Found listing with ID: NF56876
2026-03-28 12:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF56876%27 HTTP/1.1" 200 None
2026-03-28 12:08:34 [auto1.it] INFO: Scrape type for NF56876: 0
2026-03-28 12:08:34 [auto1.it] INFO: Found listing with ID: PK52051
2026-03-28 12:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK52051%27 HTTP/1.1" 200 None
2026-03-28 12:08:34 [auto1.it] INFO: Scrape type for PK52051: 0
2026-03-28 12:08:34 [auto1.it] INFO: Found listing with ID: JM74615
2026-03-28 12:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM74615%27 HTTP/1.1" 200 None
2026-03-28 12:08:34 [auto1.it] INFO: Scrape type for JM74615: 0
2026-03-28 12:08:34 [auto1.it] INFO: Found listing with ID: TD16332
2026-03-28 12:08:34 [auto1.it] INFO: Found listing with ID: RF01908
2026-03-28 12:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF01908%27 HTTP/1.1" 200 None
2026-03-28 12:08:34 [auto1.it] INFO: Scrape type for RF01908: 0
2026-03-28 12:08:34 [auto1.it] INFO: Found listing with ID: YW19585
2026-03-28 12:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW19585%27 HTTP/1.1" 200 None
2026-03-28 12:08:34 [auto1.it] INFO: Scrape type for YW19585: 2
2026-03-28 12:08:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b272eed-7010-596f-8c26-a017d8a2f9e6 with identifier: YW19585
2026-03-28 12:08:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b272eed-7010-596f-8c26-a017d8a2f9e6 with scrape type 2
2026-03-28 12:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b272eed-7010-596f-8c26-a017d8a2f9e6 with scrape type 2
2026-03-28 12:08:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7b272eed-7010-596f-8c26-a017d8a2f9e6, identifier: YW19585
2026-03-28 12:08:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7b272eed-7010-596f-8c26-a017d8a2f9e6 with identifier: YW19585
2026-03-28 12:08:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7b272eed-7010-596f-8c26-a017d8a2f9e6 with identifier: YW19585
2026-03-28 12:08:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7b272eed-7010-596f-8c26-a017d8a2f9e6 with identifier: YW19585 to the API
2026-03-28 12:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-28T16:33:13Z',
 'fuel_type': 'gas',
 'id': '7b272eed-7010-596f-8c26-a017d8a2f9e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW19585',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 23389,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-08-22',
 'seller_name': None,
 'title': 'Kia XCeed 1.0 TGDI LPG Business Class',
 'transmission': 'manual',
 'trim': 'Business Class',
 'year': 2024}
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW19585%27 HTTP/1.1" 200 None
2026-03-28 12:08:35 [auto1.it] INFO: Saving data for YW19585: {'auction_closing_time': 1774715593.0, 'created_time': 1774516010.941275, 'last_price_update_time': 1774699715.246478}
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YW19585') HTTP/1.1" 204 0
2026-03-28 12:08:35 [auto1.it] INFO: Found listing with ID: YD46190
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD46190%27 HTTP/1.1" 200 None
2026-03-28 12:08:35 [auto1.it] INFO: Scrape type for YD46190: 0
2026-03-28 12:08:35 [auto1.it] INFO: Found listing with ID: XD91118
2026-03-28 12:08:35 [auto1.it] INFO: Found listing with ID: PW09444
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW09444%27 HTTP/1.1" 200 None
2026-03-28 12:08:35 [auto1.it] INFO: Scrape type for PW09444: 0
2026-03-28 12:08:35 [auto1.it] INFO: Found listing with ID: WE18403
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WE18403%27 HTTP/1.1" 200 None
2026-03-28 12:08:35 [auto1.it] INFO: Scrape type for WE18403: 0
2026-03-28 12:08:35 [auto1.it] INFO: Found listing with ID: GY98380
2026-03-28 12:08:35 [auto1.it] INFO: Found listing with ID: BK23225
2026-03-28 12:08:35 [auto1.it] INFO: Found listing with ID: FS99230
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FS99230%27 HTTP/1.1" 200 None
2026-03-28 12:08:35 [auto1.it] INFO: Scrape type for FS99230: 0
2026-03-28 12:08:35 [auto1.it] INFO: Found listing with ID: GU51710
2026-03-28 12:08:35 [auto1.it] INFO: Found listing with ID: LC66242
2026-03-28 12:08:35 [auto1.it] INFO: Found listing with ID: CK40026
2026-03-28 12:08:35 [auto1.it] INFO: Found listing with ID: NH64941
2026-03-28 12:08:35 [auto1.it] INFO: Found listing with ID: ZW62743
2026-03-28 12:08:35 [auto1.it] INFO: Found listing with ID: GF15997
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GF15997%27 HTTP/1.1" 200 None
2026-03-28 12:08:35 [auto1.it] INFO: Scrape type for GF15997: 2
2026-03-28 12:08:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38aa5fe7-5e38-54ec-8c74-56dabe888362 with identifier: GF15997
2026-03-28 12:08:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38aa5fe7-5e38-54ec-8c74-56dabe888362 with scrape type 2
2026-03-28 12:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38aa5fe7-5e38-54ec-8c74-56dabe888362 with scrape type 2
2026-03-28 12:08:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 38aa5fe7-5e38-54ec-8c74-56dabe888362, identifier: GF15997
2026-03-28 12:08:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 38aa5fe7-5e38-54ec-8c74-56dabe888362 with identifier: GF15997
2026-03-28 12:08:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 38aa5fe7-5e38-54ec-8c74-56dabe888362 with identifier: GF15997
2026-03-28 12:08:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 38aa5fe7-5e38-54ec-8c74-56dabe888362 with identifier: GF15997 to the API
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:52:32Z',
 'fuel_type': 'diesel',
 'id': '38aa5fe7-5e38-54ec-8c74-56dabe888362',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF15997',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 110851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-07',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 40 TDI quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2020}
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GF15997%27 HTTP/1.1" 200 None
2026-03-28 12:08:35 [auto1.it] INFO: Saving data for GF15997: {'auction_closing_time': 1774716752.0, 'created_time': 1774094841.141105, 'last_price_update_time': 1774699715.776989}
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GF15997') HTTP/1.1" 204 0
2026-03-28 12:08:35 [auto1.it] INFO: Found listing with ID: TX43497
2026-03-28 12:08:35 [auto1.it] INFO: Found listing with ID: LF46608
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LF46608%27 HTTP/1.1" 200 None
2026-03-28 12:08:35 [auto1.it] INFO: Scrape type for LF46608: 0
2026-03-28 12:08:35 [auto1.it] INFO: Found listing with ID: EW58174
2026-03-28 12:08:35 [auto1.it] INFO: Found listing with ID: BJ54442
2026-03-28 12:08:35 [auto1.it] INFO: Found listing with ID: WG71830
2026-03-28 12:08:35 [auto1.it] INFO: Found listing with ID: BN39787
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN39787%27 HTTP/1.1" 200 None
2026-03-28 12:08:35 [auto1.it] INFO: Scrape type for BN39787: 0
2026-03-28 12:08:35 [auto1.it] INFO: Found listing with ID: CU47897
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU47897%27 HTTP/1.1" 200 None
2026-03-28 12:08:35 [auto1.it] INFO: Scrape type for CU47897: 0
2026-03-28 12:08:35 [auto1.it] INFO: Found listing with ID: PC45346
2026-03-28 12:08:35 [auto1.it] INFO: Found listing with ID: PP79756
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP79756%27 HTTP/1.1" 200 None
2026-03-28 12:08:35 [auto1.it] INFO: Scrape type for PP79756: 0
2026-03-28 12:08:35 [auto1.it] INFO: Found listing with ID: ET18212
2026-03-28 12:08:35 [auto1.it] INFO: Found listing with ID: UB44414
2026-03-28 12:08:35 [auto1.it] INFO: Found listing with ID: KA06591
2026-03-28 12:08:35 [auto1.it] INFO: Found listing with ID: CY67116
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CY67116%27 HTTP/1.1" 200 None
2026-03-28 12:08:35 [auto1.it] INFO: Scrape type for CY67116: 0
2026-03-28 12:08:35 [auto1.it] INFO: Found listing with ID: GN28871
2026-03-28 12:08:35 [auto1.it] INFO: Found listing with ID: GA27692
2026-03-28 12:08:35 [auto1.it] INFO: Found listing with ID: DR95248
2026-03-28 12:08:35 [auto1.it] INFO: Found listing with ID: BC82783
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BC82783%27 HTTP/1.1" 200 None
2026-03-28 12:08:35 [auto1.it] INFO: Scrape type for BC82783: 0
2026-03-28 12:08:35 [auto1.it] INFO: Found listing with ID: NR20429
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR20429%27 HTTP/1.1" 200 None
2026-03-28 12:08:35 [auto1.it] INFO: Scrape type for NR20429: 0
2026-03-28 12:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:08:37 [auto1.it] INFO: Channel: 24h | Page: 40 | totalHits: 3675 | hits on page: 40
2026-03-28 12:08:37 [auto1.it] INFO: Found listing with ID: WK48161
2026-03-28 12:08:37 [auto1.it] INFO: Found listing with ID: NV90062
2026-03-28 12:08:37 [auto1.it] INFO: Found listing with ID: EE16681
2026-03-28 12:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE16681%27 HTTP/1.1" 200 None
2026-03-28 12:08:37 [auto1.it] INFO: Scrape type for EE16681: 0
2026-03-28 12:08:37 [auto1.it] INFO: Found listing with ID: FR49245
2026-03-28 12:08:37 [auto1.it] INFO: Found listing with ID: RY75551
2026-03-28 12:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY75551%27 HTTP/1.1" 200 None
2026-03-28 12:08:37 [auto1.it] INFO: Scrape type for RY75551: 2
2026-03-28 12:08:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 010952bf-175f-5464-b975-75d62ac4b783 with identifier: RY75551
2026-03-28 12:08:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 010952bf-175f-5464-b975-75d62ac4b783 with scrape type 2
2026-03-28 12:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 010952bf-175f-5464-b975-75d62ac4b783 with scrape type 2
2026-03-28 12:08:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 010952bf-175f-5464-b975-75d62ac4b783, identifier: RY75551
2026-03-28 12:08:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 010952bf-175f-5464-b975-75d62ac4b783 with identifier: RY75551
2026-03-28 12:08:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 010952bf-175f-5464-b975-75d62ac4b783 with identifier: RY75551
2026-03-28 12:08:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 010952bf-175f-5464-b975-75d62ac4b783 with identifier: RY75551 to the API
2026-03-28 12:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-28T16:14:38Z',
 'fuel_type': 'diesel',
 'id': '010952bf-175f-5464-b975-75d62ac4b783',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY75551',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 214502,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-27',
 'seller_name': None,
 'title': 'BMW 3er 335d xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2017}
2026-03-28 12:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY75551%27 HTTP/1.1" 200 None
2026-03-28 12:08:37 [auto1.it] INFO: Saving data for RY75551: {'auction_closing_time': 1774714478.0, 'created_time': 1773781737.981999, 'last_price_update_time': 1774699717.449293}
2026-03-28 12:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RY75551') HTTP/1.1" 204 0
2026-03-28 12:08:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:08:37 [auto1.it] INFO: Found listing with ID: ZR71790
2026-03-28 12:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR71790%27 HTTP/1.1" 200 None
2026-03-28 12:08:37 [auto1.it] INFO: Scrape type for ZR71790: 0
2026-03-28 12:08:37 [auto1.it] INFO: Found listing with ID: KF98112
2026-03-28 12:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF98112%27 HTTP/1.1" 200 None
2026-03-28 12:08:37 [auto1.it] INFO: Scrape type for KF98112: 0
2026-03-28 12:08:37 [auto1.it] INFO: Found listing with ID: XK39914
2026-03-28 12:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XK39914%27 HTTP/1.1" 200 None
2026-03-28 12:08:37 [auto1.it] INFO: Scrape type for XK39914: 2
2026-03-28 12:08:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf4fd47b-72c1-5ffc-a1e9-5da85d94254a with identifier: XK39914
2026-03-28 12:08:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf4fd47b-72c1-5ffc-a1e9-5da85d94254a with scrape type 2
2026-03-28 12:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf4fd47b-72c1-5ffc-a1e9-5da85d94254a with scrape type 2
2026-03-28 12:08:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bf4fd47b-72c1-5ffc-a1e9-5da85d94254a, identifier: XK39914
2026-03-28 12:08:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bf4fd47b-72c1-5ffc-a1e9-5da85d94254a with identifier: XK39914
2026-03-28 12:08:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bf4fd47b-72c1-5ffc-a1e9-5da85d94254a with identifier: XK39914
2026-03-28 12:08:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bf4fd47b-72c1-5ffc-a1e9-5da85d94254a with identifier: XK39914 to the API
2026-03-28 12:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:06:09Z',
 'fuel_type': 'diesel',
 'id': 'bf4fd47b-72c1-5ffc-a1e9-5da85d94254a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK39914',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 229004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-12-31',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 270 CDI Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2003}
2026-03-28 12:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XK39914%27 HTTP/1.1" 200 None
2026-03-28 12:08:37 [auto1.it] INFO: Saving data for XK39914: {'auction_closing_time': 1774713969.0, 'created_time': 1774515957.71423, 'last_price_update_time': 1774699717.999232}
2026-03-28 12:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XK39914') HTTP/1.1" 204 0
2026-03-28 12:08:38 [auto1.it] INFO: Found listing with ID: KA09698
2026-03-28 12:08:38 [auto1.it] INFO: Found listing with ID: UD95493
2026-03-28 12:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD95493%27 HTTP/1.1" 200 None
2026-03-28 12:08:38 [auto1.it] INFO: Scrape type for UD95493: 0
2026-03-28 12:08:38 [auto1.it] INFO: Found listing with ID: UB69293
2026-03-28 12:08:38 [auto1.it] INFO: Found listing with ID: DW64097
2026-03-28 12:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW64097%27 HTTP/1.1" 200 None
2026-03-28 12:08:38 [auto1.it] INFO: Scrape type for DW64097: 0
2026-03-28 12:08:38 [auto1.it] INFO: Found listing with ID: AR58542
2026-03-28 12:08:38 [auto1.it] INFO: Found listing with ID: AP13803
2026-03-28 12:08:38 [auto1.it] INFO: Found listing with ID: BA49572
2026-03-28 12:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA49572%27 HTTP/1.1" 200 None
2026-03-28 12:08:38 [auto1.it] INFO: Scrape type for BA49572: 0
2026-03-28 12:08:38 [auto1.it] INFO: Found listing with ID: AH31892
2026-03-28 12:08:38 [auto1.it] INFO: Found listing with ID: JZ33949
2026-03-28 12:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ33949%27 HTTP/1.1" 200 None
2026-03-28 12:08:38 [auto1.it] INFO: Scrape type for JZ33949: 0
2026-03-28 12:08:38 [auto1.it] INFO: Found listing with ID: HG28302
2026-03-28 12:08:38 [auto1.it] INFO: Found listing with ID: MZ33664
2026-03-28 12:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MZ33664%27 HTTP/1.1" 200 None
2026-03-28 12:08:38 [auto1.it] INFO: Scrape type for MZ33664: 0
2026-03-28 12:08:38 [auto1.it] INFO: Found listing with ID: DH47051
2026-03-28 12:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DH47051%27 HTTP/1.1" 200 None
2026-03-28 12:08:38 [auto1.it] INFO: Scrape type for DH47051: 0
2026-03-28 12:08:38 [auto1.it] INFO: Found listing with ID: SV45287
2026-03-28 12:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV45287%27 HTTP/1.1" 200 None
2026-03-28 12:08:38 [auto1.it] INFO: Scrape type for SV45287: 0
2026-03-28 12:08:38 [auto1.it] INFO: Found listing with ID: YR08736
2026-03-28 12:08:38 [auto1.it] INFO: Found listing with ID: JM31879
2026-03-28 12:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM31879%27 HTTP/1.1" 200 None
2026-03-28 12:08:38 [auto1.it] INFO: Scrape type for JM31879: 2
2026-03-28 12:08:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7788ba46-3b9d-5c7e-8bab-a3e2c223e460 with identifier: JM31879
2026-03-28 12:08:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7788ba46-3b9d-5c7e-8bab-a3e2c223e460 with scrape type 2
2026-03-28 12:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7788ba46-3b9d-5c7e-8bab-a3e2c223e460 with scrape type 2
2026-03-28 12:08:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7788ba46-3b9d-5c7e-8bab-a3e2c223e460, identifier: JM31879
2026-03-28 12:08:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7788ba46-3b9d-5c7e-8bab-a3e2c223e460 with identifier: JM31879
2026-03-28 12:08:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7788ba46-3b9d-5c7e-8bab-a3e2c223e460 with identifier: JM31879
2026-03-28 12:08:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7788ba46-3b9d-5c7e-8bab-a3e2c223e460 with identifier: JM31879 to the API
2026-03-28 12:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:42:56Z',
 'fuel_type': 'diesel',
 'id': '7788ba46-3b9d-5c7e-8bab-a3e2c223e460',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM31879',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 269729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-28',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2012}
2026-03-28 12:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM31879%27 HTTP/1.1" 200 None
2026-03-28 12:08:38 [auto1.it] INFO: Saving data for JM31879: {'auction_closing_time': 1774716176.0, 'created_time': 1774516057.919194, 'last_price_update_time': 1774699718.535311}
2026-03-28 12:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JM31879') HTTP/1.1" 204 0
2026-03-28 12:08:38 [auto1.it] INFO: Found listing with ID: BB73520
2026-03-28 12:08:38 [auto1.it] INFO: Found listing with ID: BX36809
2026-03-28 12:08:38 [auto1.it] INFO: Found listing with ID: MD72836
2026-03-28 12:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD72836%27 HTTP/1.1" 200 None
2026-03-28 12:08:38 [auto1.it] INFO: Scrape type for MD72836: 2
2026-03-28 12:08:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a4a5f7d-9537-5cea-84e0-fd9e37ef80f1 with identifier: MD72836
2026-03-28 12:08:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a4a5f7d-9537-5cea-84e0-fd9e37ef80f1 with scrape type 2
2026-03-28 12:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a4a5f7d-9537-5cea-84e0-fd9e37ef80f1 with scrape type 2
2026-03-28 12:08:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2a4a5f7d-9537-5cea-84e0-fd9e37ef80f1, identifier: MD72836
2026-03-28 12:08:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2a4a5f7d-9537-5cea-84e0-fd9e37ef80f1 with identifier: MD72836
2026-03-28 12:08:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2a4a5f7d-9537-5cea-84e0-fd9e37ef80f1 with identifier: MD72836
2026-03-28 12:08:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2a4a5f7d-9537-5cea-84e0-fd9e37ef80f1 with identifier: MD72836 to the API
2026-03-28 12:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:50:03Z',
 'fuel_type': 'petrol',
 'id': '2a4a5f7d-9537-5cea-84e0-fd9e37ef80f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD72836',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 101554,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-15',
 'seller_name': None,
 'title': 'Opel Mokka 1.6 Ego ecoFlex',
 'transmission': 'manual',
 'trim': 'Ego ecoFlex',
 'year': 2014}
2026-03-28 12:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD72836%27 HTTP/1.1" 200 None
2026-03-28 12:08:39 [auto1.it] INFO: Saving data for MD72836: {'auction_closing_time': 1774716603.0, 'created_time': 1774516013.96005, 'last_price_update_time': 1774699719.080878}
2026-03-28 12:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MD72836') HTTP/1.1" 204 0
2026-03-28 12:08:39 [auto1.it] INFO: Found listing with ID: CU10476
2026-03-28 12:08:39 [auto1.it] INFO: Found listing with ID: SJ04841
2026-03-28 12:08:39 [auto1.it] INFO: Found listing with ID: VV36209
2026-03-28 12:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV36209%27 HTTP/1.1" 200 None
2026-03-28 12:08:39 [auto1.it] INFO: Scrape type for VV36209: 2
2026-03-28 12:08:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77043ec7-7144-5016-bd2c-d8f4d2262e04 with identifier: VV36209
2026-03-28 12:08:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77043ec7-7144-5016-bd2c-d8f4d2262e04 with scrape type 2
2026-03-28 12:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77043ec7-7144-5016-bd2c-d8f4d2262e04 with scrape type 2
2026-03-28 12:08:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 77043ec7-7144-5016-bd2c-d8f4d2262e04, identifier: VV36209
2026-03-28 12:08:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 77043ec7-7144-5016-bd2c-d8f4d2262e04 with identifier: VV36209
2026-03-28 12:08:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 77043ec7-7144-5016-bd2c-d8f4d2262e04 with identifier: VV36209
2026-03-28 12:08:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 77043ec7-7144-5016-bd2c-d8f4d2262e04 with identifier: VV36209 to the API
2026-03-28 12:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:50:52Z',
 'fuel_type': 'diesel',
 'id': '77043ec7-7144-5016-bd2c-d8f4d2262e04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV36209',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat Alltrack',
 'odometer': 222900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-26',
 'seller_name': None,
 'title': 'Volkswagen Passat Alltrack 2.0 TDI 4Motion BlueMotion Tech',
 'transmission': 'automatic',
 'trim': '4Motion BlueMotion Tech',
 'year': 2016}
2026-03-28 12:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV36209%27 HTTP/1.1" 200 None
2026-03-28 12:08:39 [auto1.it] INFO: Saving data for VV36209: {'auction_closing_time': 1774716652.0, 'created_time': 1773824816.620453, 'last_price_update_time': 1774699719.491263}
2026-03-28 12:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VV36209') HTTP/1.1" 204 0
2026-03-28 12:08:39 [auto1.it] INFO: Found listing with ID: FL80694
2026-03-28 12:08:39 [auto1.it] INFO: Found listing with ID: EM88233
2026-03-28 12:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EM88233%27 HTTP/1.1" 200 None
2026-03-28 12:08:39 [auto1.it] INFO: Scrape type for EM88233: 0
2026-03-28 12:08:39 [auto1.it] INFO: Found listing with ID: FF42282
2026-03-28 12:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF42282%27 HTTP/1.1" 200 None
2026-03-28 12:08:39 [auto1.it] INFO: Scrape type for FF42282: 0
2026-03-28 12:08:39 [auto1.it] INFO: Found listing with ID: UH38063
2026-03-28 12:08:39 [auto1.it] INFO: Found listing with ID: BR49145
2026-03-28 12:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR49145%27 HTTP/1.1" 200 None
2026-03-28 12:08:39 [auto1.it] INFO: Scrape type for BR49145: 0
2026-03-28 12:08:39 [auto1.it] INFO: Found listing with ID: XE50216
2026-03-28 12:08:39 [auto1.it] INFO: Found listing with ID: VH95383
2026-03-28 12:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH95383%27 HTTP/1.1" 200 None
2026-03-28 12:08:39 [auto1.it] INFO: Scrape type for VH95383: 0
2026-03-28 12:08:39 [auto1.it] INFO: Found listing with ID: VB21815
2026-03-28 12:08:39 [auto1.it] INFO: Found listing with ID: WU32452
2026-03-28 12:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU32452%27 HTTP/1.1" 200 None
2026-03-28 12:08:39 [auto1.it] INFO: Scrape type for WU32452: 0
2026-03-28 12:08:39 [auto1.it] INFO: Found listing with ID: KW78911
2026-03-28 12:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW78911%27 HTTP/1.1" 200 None
2026-03-28 12:08:39 [auto1.it] INFO: Scrape type for KW78911: 0
2026-03-28 12:08:39 [auto1.it] INFO: Found listing with ID: AB01371
2026-03-28 12:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB01371%27 HTTP/1.1" 200 None
2026-03-28 12:08:39 [auto1.it] INFO: Scrape type for AB01371: 0
2026-03-28 12:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:08:40 [auto1.it] INFO: Channel: 24h | Page: 41 | totalHits: 3675 | hits on page: 40
2026-03-28 12:08:40 [auto1.it] INFO: Found listing with ID: XF08656
2026-03-28 12:08:40 [auto1.it] INFO: Found listing with ID: BT51990
2026-03-28 12:08:40 [auto1.it] INFO: Found listing with ID: CT54414
2026-03-28 12:08:40 [auto1.it] INFO: Found listing with ID: BJ21664
2026-03-28 12:08:40 [auto1.it] INFO: Found listing with ID: ET28084
2026-03-28 12:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET28084%27 HTTP/1.1" 200 None
2026-03-28 12:08:40 [auto1.it] INFO: Scrape type for ET28084: 0
2026-03-28 12:08:40 [auto1.it] INFO: Found listing with ID: JS18967
2026-03-28 12:08:40 [auto1.it] INFO: Found listing with ID: UT61687
2026-03-28 12:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT61687%27 HTTP/1.1" 200 None
2026-03-28 12:08:40 [auto1.it] INFO: Scrape type for UT61687: 0
2026-03-28 12:08:40 [auto1.it] INFO: Found listing with ID: KV14402
2026-03-28 12:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KV14402%27 HTTP/1.1" 200 None
2026-03-28 12:08:40 [auto1.it] INFO: Scrape type for KV14402: 0
2026-03-28 12:08:40 [auto1.it] INFO: Found listing with ID: KV97590
2026-03-28 12:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KV97590%27 HTTP/1.1" 200 None
2026-03-28 12:08:40 [auto1.it] INFO: Scrape type for KV97590: 0
2026-03-28 12:08:40 [auto1.it] INFO: Found listing with ID: SN54717
2026-03-28 12:08:40 [auto1.it] INFO: Found listing with ID: PF84937
2026-03-28 12:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PF84937%27 HTTP/1.1" 200 None
2026-03-28 12:08:40 [auto1.it] INFO: Scrape type for PF84937: 0
2026-03-28 12:08:40 [auto1.it] INFO: Found listing with ID: DT23804
2026-03-28 12:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT23804%27 HTTP/1.1" 200 None
2026-03-28 12:08:40 [auto1.it] INFO: Scrape type for DT23804: 0
2026-03-28 12:08:40 [auto1.it] INFO: Found listing with ID: UE59883
2026-03-28 12:08:40 [auto1.it] INFO: Found listing with ID: KX90230
2026-03-28 12:08:40 [auto1.it] INFO: Found listing with ID: HU53243
2026-03-28 12:08:40 [auto1.it] INFO: Found listing with ID: ZD91383
2026-03-28 12:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD91383%27 HTTP/1.1" 200 None
2026-03-28 12:08:40 [auto1.it] INFO: Scrape type for ZD91383: 0
2026-03-28 12:08:40 [auto1.it] INFO: Found listing with ID: PZ68086
2026-03-28 12:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ68086%27 HTTP/1.1" 200 None
2026-03-28 12:08:40 [auto1.it] INFO: Scrape type for PZ68086: 0
2026-03-28 12:08:40 [auto1.it] INFO: Found listing with ID: AC58297
2026-03-28 12:08:40 [auto1.it] INFO: Found listing with ID: ED83032
2026-03-28 12:08:40 [auto1.it] INFO: Found listing with ID: ZJ46829
2026-03-28 12:08:40 [auto1.it] INFO: Found listing with ID: XW11581
2026-03-28 12:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW11581%27 HTTP/1.1" 200 None
2026-03-28 12:08:40 [auto1.it] INFO: Scrape type for XW11581: 0
2026-03-28 12:08:40 [auto1.it] INFO: Found listing with ID: BS34699
2026-03-28 12:08:40 [auto1.it] INFO: Found listing with ID: FA74836
2026-03-28 12:08:40 [auto1.it] INFO: Found listing with ID: VB18666
2026-03-28 12:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB18666%27 HTTP/1.1" 200 None
2026-03-28 12:08:40 [auto1.it] INFO: Scrape type for VB18666: 0
2026-03-28 12:08:40 [auto1.it] INFO: Found listing with ID: YU90984
2026-03-28 12:08:40 [auto1.it] INFO: Found listing with ID: TF40729
2026-03-28 12:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF40729%27 HTTP/1.1" 200 None
2026-03-28 12:08:40 [auto1.it] INFO: Scrape type for TF40729: 0
2026-03-28 12:08:40 [auto1.it] INFO: Found listing with ID: LN63295
2026-03-28 12:08:40 [auto1.it] INFO: Found listing with ID: DA14696
2026-03-28 12:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA14696%27 HTTP/1.1" 200 None
2026-03-28 12:08:40 [auto1.it] INFO: Scrape type for DA14696: 2
2026-03-28 12:08:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 407ba0ff-4787-5d8c-b9db-3d78d4755fa1 with identifier: DA14696
2026-03-28 12:08:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 407ba0ff-4787-5d8c-b9db-3d78d4755fa1 with scrape type 2
2026-03-28 12:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 407ba0ff-4787-5d8c-b9db-3d78d4755fa1 with scrape type 2
2026-03-28 12:08:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 407ba0ff-4787-5d8c-b9db-3d78d4755fa1, identifier: DA14696
2026-03-28 12:08:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 407ba0ff-4787-5d8c-b9db-3d78d4755fa1 with identifier: DA14696
2026-03-28 12:08:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 407ba0ff-4787-5d8c-b9db-3d78d4755fa1 with identifier: DA14696
2026-03-28 12:08:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 407ba0ff-4787-5d8c-b9db-3d78d4755fa1 with identifier: DA14696 to the API
2026-03-28 12:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:04:50Z',
 'fuel_type': 'diesel',
 'id': '407ba0ff-4787-5d8c-b9db-3d78d4755fa1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA14696',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 182317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-28',
 'seller_name': None,
 'title': 'Citroen C3 1.4 HDi Confort',
 'transmission': 'manual',
 'trim': 'Confort',
 'year': 2009}
2026-03-28 12:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA14696%27 HTTP/1.1" 200 None
2026-03-28 12:08:41 [auto1.it] INFO: Saving data for DA14696: {'auction_closing_time': 1774713890.0, 'created_time': 1774515966.551514, 'last_price_update_time': 1774699721.133135}
2026-03-28 12:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DA14696') HTTP/1.1" 204 0
2026-03-28 12:08:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:08:41 [auto1.it] INFO: Found listing with ID: YX40722
2026-03-28 12:08:41 [auto1.it] INFO: Found listing with ID: WS98369
2026-03-28 12:08:41 [auto1.it] INFO: Found listing with ID: JW15936
2026-03-28 12:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JW15936%27 HTTP/1.1" 200 None
2026-03-28 12:08:41 [auto1.it] INFO: Scrape type for JW15936: 0
2026-03-28 12:08:41 [auto1.it] INFO: Found listing with ID: HG36581
2026-03-28 12:08:41 [auto1.it] INFO: Found listing with ID: BF27617
2026-03-28 12:08:41 [auto1.it] INFO: Found listing with ID: FH04610
2026-03-28 12:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FH04610%27 HTTP/1.1" 200 None
2026-03-28 12:08:41 [auto1.it] INFO: Scrape type for FH04610: 0
2026-03-28 12:08:41 [auto1.it] INFO: Found listing with ID: WU42873
2026-03-28 12:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU42873%27 HTTP/1.1" 200 None
2026-03-28 12:08:41 [auto1.it] INFO: Scrape type for WU42873: 0
2026-03-28 12:08:41 [auto1.it] INFO: Found listing with ID: HW72110
2026-03-28 12:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW72110%27 HTTP/1.1" 200 None
2026-03-28 12:08:41 [auto1.it] INFO: Scrape type for HW72110: 0
2026-03-28 12:08:41 [auto1.it] INFO: Found listing with ID: ZF50990
2026-03-28 12:08:41 [auto1.it] INFO: Found listing with ID: LD57265
2026-03-28 12:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD57265%27 HTTP/1.1" 200 None
2026-03-28 12:08:41 [auto1.it] INFO: Scrape type for LD57265: 0
2026-03-28 12:08:41 [auto1.it] INFO: Found listing with ID: TA99011
2026-03-28 12:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TA99011%27 HTTP/1.1" 200 None
2026-03-28 12:08:41 [auto1.it] INFO: Scrape type for TA99011: 0
2026-03-28 12:08:41 [auto1.it] INFO: Found listing with ID: KR59858
2026-03-28 12:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:08:42 [auto1.it] INFO: Channel: 24h | Page: 42 | totalHits: 3675 | hits on page: 40
2026-03-28 12:08:42 [auto1.it] INFO: Found listing with ID: SK65228
2026-03-28 12:08:42 [auto1.it] INFO: Found listing with ID: VS16589
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS16589%27 HTTP/1.1" 200 None
2026-03-28 12:08:42 [auto1.it] INFO: Scrape type for VS16589: 0
2026-03-28 12:08:42 [auto1.it] INFO: Found listing with ID: RY64752
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY64752%27 HTTP/1.1" 200 None
2026-03-28 12:08:42 [auto1.it] INFO: Scrape type for RY64752: 0
2026-03-28 12:08:42 [auto1.it] INFO: Found listing with ID: XW75946
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW75946%27 HTTP/1.1" 200 None
2026-03-28 12:08:42 [auto1.it] INFO: Scrape type for XW75946: 0
2026-03-28 12:08:42 [auto1.it] INFO: Found listing with ID: ZU45449
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU45449%27 HTTP/1.1" 200 None
2026-03-28 12:08:42 [auto1.it] INFO: Scrape type for ZU45449: 0
2026-03-28 12:08:42 [auto1.it] INFO: Found listing with ID: WM58215
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM58215%27 HTTP/1.1" 200 None
2026-03-28 12:08:42 [auto1.it] INFO: Scrape type for WM58215: 0
2026-03-28 12:08:42 [auto1.it] INFO: Found listing with ID: ZP08653
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP08653%27 HTTP/1.1" 200 None
2026-03-28 12:08:42 [auto1.it] INFO: Scrape type for ZP08653: 0
2026-03-28 12:08:42 [auto1.it] INFO: Found listing with ID: MT35916
2026-03-28 12:08:42 [auto1.it] INFO: Found listing with ID: XH06429
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH06429%27 HTTP/1.1" 200 None
2026-03-28 12:08:42 [auto1.it] INFO: Scrape type for XH06429: 0
2026-03-28 12:08:42 [auto1.it] INFO: Found listing with ID: JB22661
2026-03-28 12:08:42 [auto1.it] INFO: Found listing with ID: TW76525
2026-03-28 12:08:42 [auto1.it] INFO: Found listing with ID: CP76510
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP76510%27 HTTP/1.1" 200 None
2026-03-28 12:08:42 [auto1.it] INFO: Scrape type for CP76510: 0
2026-03-28 12:08:42 [auto1.it] INFO: Found listing with ID: TB87558
2026-03-28 12:08:42 [auto1.it] INFO: Found listing with ID: CC19770
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC19770%27 HTTP/1.1" 200 None
2026-03-28 12:08:42 [auto1.it] INFO: Scrape type for CC19770: 0
2026-03-28 12:08:42 [auto1.it] INFO: Found listing with ID: VY00315
2026-03-28 12:08:42 [auto1.it] INFO: Found listing with ID: PD51522
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD51522%27 HTTP/1.1" 200 None
2026-03-28 12:08:42 [auto1.it] INFO: Scrape type for PD51522: 0
2026-03-28 12:08:42 [auto1.it] INFO: Found listing with ID: VW75885
2026-03-28 12:08:42 [auto1.it] INFO: Found listing with ID: PA11194
2026-03-28 12:08:42 [auto1.it] INFO: Found listing with ID: KT64374
2026-03-28 12:08:42 [auto1.it] INFO: Found listing with ID: HS22192
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS22192%27 HTTP/1.1" 200 None
2026-03-28 12:08:42 [auto1.it] INFO: Scrape type for HS22192: 0
2026-03-28 12:08:42 [auto1.it] INFO: Found listing with ID: GU77220
2026-03-28 12:08:42 [auto1.it] INFO: Found listing with ID: KC61332
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC61332%27 HTTP/1.1" 200 None
2026-03-28 12:08:42 [auto1.it] INFO: Scrape type for KC61332: 0
2026-03-28 12:08:42 [auto1.it] INFO: Found listing with ID: VZ02173
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VZ02173%27 HTTP/1.1" 200 None
2026-03-28 12:08:42 [auto1.it] INFO: Scrape type for VZ02173: 0
2026-03-28 12:08:42 [auto1.it] INFO: Found listing with ID: GR02262
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR02262%27 HTTP/1.1" 200 None
2026-03-28 12:08:42 [auto1.it] INFO: Scrape type for GR02262: 0
2026-03-28 12:08:42 [auto1.it] INFO: Found listing with ID: LJ91384
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LJ91384%27 HTTP/1.1" 200 None
2026-03-28 12:08:42 [auto1.it] INFO: Scrape type for LJ91384: 0
2026-03-28 12:08:42 [auto1.it] INFO: Found listing with ID: CY31858
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CY31858%27 HTTP/1.1" 200 None
2026-03-28 12:08:42 [auto1.it] INFO: Scrape type for CY31858: 0
2026-03-28 12:08:42 [auto1.it] INFO: Found listing with ID: WM29038
2026-03-28 12:08:42 [auto1.it] INFO: Found listing with ID: XN45534
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN45534%27 HTTP/1.1" 200 None
2026-03-28 12:08:42 [auto1.it] INFO: Scrape type for XN45534: 0
2026-03-28 12:08:42 [auto1.it] INFO: Found listing with ID: LR14245
2026-03-28 12:08:42 [auto1.it] INFO: Found listing with ID: UH68033
2026-03-28 12:08:42 [auto1.it] INFO: Found listing with ID: VN85673
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VN85673%27 HTTP/1.1" 200 None
2026-03-28 12:08:42 [auto1.it] INFO: Scrape type for VN85673: 2
2026-03-28 12:08:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39af9baf-e596-5a85-b3f6-e4d4c2afb727 with identifier: VN85673
2026-03-28 12:08:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39af9baf-e596-5a85-b3f6-e4d4c2afb727 with scrape type 2
2026-03-28 12:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39af9baf-e596-5a85-b3f6-e4d4c2afb727 with scrape type 2
2026-03-28 12:08:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 39af9baf-e596-5a85-b3f6-e4d4c2afb727, identifier: VN85673
2026-03-28 12:08:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 39af9baf-e596-5a85-b3f6-e4d4c2afb727 with identifier: VN85673
2026-03-28 12:08:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 39af9baf-e596-5a85-b3f6-e4d4c2afb727 with identifier: VN85673
2026-03-28 12:08:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 39af9baf-e596-5a85-b3f6-e4d4c2afb727 with identifier: VN85673 to the API
2026-03-28 12:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:22:12Z',
 'fuel_type': 'diesel',
 'id': '39af9baf-e596-5a85-b3f6-e4d4c2afb727',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN85673',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 73948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-01',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Sd4 SE Dynamic',
 'transmission': 'automatic',
 'trim': 'SE Dynamic',
 'year': 2018}
2026-03-28 12:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VN85673%27 HTTP/1.1" 200 None
2026-03-28 12:08:43 [auto1.it] INFO: Saving data for VN85673: {'auction_closing_time': 1774714932.0, 'created_time': 1774515997.190802, 'last_price_update_time': 1774699723.12253}
2026-03-28 12:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VN85673') HTTP/1.1" 204 0
2026-03-28 12:08:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:08:43 [auto1.it] INFO: Found listing with ID: RM92926
2026-03-28 12:08:43 [auto1.it] INFO: Found listing with ID: NV20276
2026-03-28 12:08:43 [auto1.it] INFO: Found listing with ID: UX25777
2026-03-28 12:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX25777%27 HTTP/1.1" 200 None
2026-03-28 12:08:43 [auto1.it] INFO: Scrape type for UX25777: 0
2026-03-28 12:08:43 [auto1.it] INFO: Found listing with ID: EK30542
2026-03-28 12:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK30542%27 HTTP/1.1" 200 None
2026-03-28 12:08:43 [auto1.it] INFO: Scrape type for EK30542: 0
2026-03-28 12:08:43 [auto1.it] INFO: Found listing with ID: ME36954
2026-03-28 12:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME36954%27 HTTP/1.1" 200 None
2026-03-28 12:08:43 [auto1.it] INFO: Scrape type for ME36954: 0
2026-03-28 12:08:43 [auto1.it] INFO: Found listing with ID: FY24285
2026-03-28 12:08:43 [auto1.it] INFO: Found listing with ID: GW87454
2026-03-28 12:08:43 [auto1.it] INFO: Found listing with ID: JS13846
2026-03-28 12:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS13846%27 HTTP/1.1" 200 None
2026-03-28 12:08:43 [auto1.it] INFO: Scrape type for JS13846: 0
2026-03-28 12:08:43 [auto1.it] INFO: Found listing with ID: NB30604
2026-03-28 12:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:08:44 [auto1.it] INFO: Channel: 24h | Page: 43 | totalHits: 3675 | hits on page: 40
2026-03-28 12:08:44 [auto1.it] INFO: Found listing with ID: CS63696
2026-03-28 12:08:44 [auto1.it] INFO: Found listing with ID: HW76597
2026-03-28 12:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW76597%27 HTTP/1.1" 200 None
2026-03-28 12:08:44 [auto1.it] INFO: Scrape type for HW76597: 0
2026-03-28 12:08:44 [auto1.it] INFO: Found listing with ID: AB32606
2026-03-28 12:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB32606%27 HTTP/1.1" 200 None
2026-03-28 12:08:44 [auto1.it] INFO: Scrape type for AB32606: 0
2026-03-28 12:08:44 [auto1.it] INFO: Found listing with ID: TM60577
2026-03-28 12:08:44 [auto1.it] INFO: Found listing with ID: NT36373
2026-03-28 12:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT36373%27 HTTP/1.1" 200 None
2026-03-28 12:08:44 [auto1.it] INFO: Scrape type for NT36373: 0
2026-03-28 12:08:44 [auto1.it] INFO: Found listing with ID: YX73536
2026-03-28 12:08:44 [auto1.it] INFO: Found listing with ID: YH73900
2026-03-28 12:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH73900%27 HTTP/1.1" 200 None
2026-03-28 12:08:44 [auto1.it] INFO: Scrape type for YH73900: 0
2026-03-28 12:08:44 [auto1.it] INFO: Found listing with ID: TN90495
2026-03-28 12:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TN90495%27 HTTP/1.1" 200 None
2026-03-28 12:08:44 [auto1.it] INFO: Scrape type for TN90495: 0
2026-03-28 12:08:44 [auto1.it] INFO: Found listing with ID: UE02945
2026-03-28 12:08:44 [auto1.it] INFO: Found listing with ID: AX03147
2026-03-28 12:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AX03147%27 HTTP/1.1" 200 None
2026-03-28 12:08:44 [auto1.it] INFO: Scrape type for AX03147: 0
2026-03-28 12:08:44 [auto1.it] INFO: Found listing with ID: BZ92290
2026-03-28 12:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ92290%27 HTTP/1.1" 200 None
2026-03-28 12:08:44 [auto1.it] INFO: Scrape type for BZ92290: 0
2026-03-28 12:08:44 [auto1.it] INFO: Found listing with ID: PB66725
2026-03-28 12:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PB66725%27 HTTP/1.1" 200 None
2026-03-28 12:08:44 [auto1.it] INFO: Scrape type for PB66725: 0
2026-03-28 12:08:44 [auto1.it] INFO: Found listing with ID: TB34384
2026-03-28 12:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB34384%27 HTTP/1.1" 200 None
2026-03-28 12:08:44 [auto1.it] INFO: Scrape type for TB34384: 0
2026-03-28 12:08:44 [auto1.it] INFO: Found listing with ID: MJ42614
2026-03-28 12:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ42614%27 HTTP/1.1" 200 None
2026-03-28 12:08:44 [auto1.it] INFO: Scrape type for MJ42614: 0
2026-03-28 12:08:44 [auto1.it] INFO: Found listing with ID: RJ57897
2026-03-28 12:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ57897%27 HTTP/1.1" 200 None
2026-03-28 12:08:44 [auto1.it] INFO: Scrape type for RJ57897: 2
2026-03-28 12:08:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4308032-0333-5955-8263-80e2d923c031 with identifier: RJ57897
2026-03-28 12:08:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4308032-0333-5955-8263-80e2d923c031 with scrape type 2
2026-03-28 12:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4308032-0333-5955-8263-80e2d923c031 with scrape type 2
2026-03-28 12:08:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d4308032-0333-5955-8263-80e2d923c031, identifier: RJ57897
2026-03-28 12:08:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d4308032-0333-5955-8263-80e2d923c031 with identifier: RJ57897
2026-03-28 12:08:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d4308032-0333-5955-8263-80e2d923c031 with identifier: RJ57897
2026-03-28 12:08:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d4308032-0333-5955-8263-80e2d923c031 with identifier: RJ57897 to the API
2026-03-28 12:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:51:12Z',
 'fuel_type': 'diesel',
 'id': 'd4308032-0333-5955-8263-80e2d923c031',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ57897',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 143012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-04',
 'seller_name': None,
 'title': 'Fiat Panda 1.3 M-Jet Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2018}
2026-03-28 12:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ57897%27 HTTP/1.1" 200 None
2026-03-28 12:08:44 [auto1.it] INFO: Saving data for RJ57897: {'auction_closing_time': 1774716672.0, 'created_time': 1774516040.992132, 'last_price_update_time': 1774699724.85478}
2026-03-28 12:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RJ57897') HTTP/1.1" 204 0
2026-03-28 12:08:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:08:44 [auto1.it] INFO: Found listing with ID: GT90583
2026-03-28 12:08:44 [auto1.it] INFO: Found listing with ID: BJ81440
2026-03-28 12:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ81440%27 HTTP/1.1" 200 None
2026-03-28 12:08:44 [auto1.it] INFO: Scrape type for BJ81440: 0
2026-03-28 12:08:44 [auto1.it] INFO: Found listing with ID: AF34826
2026-03-28 12:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF34826%27 HTTP/1.1" 200 None
2026-03-28 12:08:44 [auto1.it] INFO: Scrape type for AF34826: 0
2026-03-28 12:08:44 [auto1.it] INFO: Found listing with ID: UC76692
2026-03-28 12:08:44 [auto1.it] INFO: Found listing with ID: XX89232
2026-03-28 12:08:44 [auto1.it] INFO: Found listing with ID: PW51230
2026-03-28 12:08:44 [auto1.it] INFO: Found listing with ID: TU80185
2026-03-28 12:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU80185%27 HTTP/1.1" 200 None
2026-03-28 12:08:45 [auto1.it] INFO: Scrape type for TU80185: 0
2026-03-28 12:08:45 [auto1.it] INFO: Found listing with ID: KE18489
2026-03-28 12:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE18489%27 HTTP/1.1" 200 None
2026-03-28 12:08:45 [auto1.it] INFO: Scrape type for KE18489: 0
2026-03-28 12:08:45 [auto1.it] INFO: Found listing with ID: TN86545
2026-03-28 12:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TN86545%27 HTTP/1.1" 200 None
2026-03-28 12:08:45 [auto1.it] INFO: Scrape type for TN86545: 0
2026-03-28 12:08:45 [auto1.it] INFO: Found listing with ID: DT89557
2026-03-28 12:08:45 [auto1.it] INFO: Found listing with ID: SN05333
2026-03-28 12:08:45 [auto1.it] INFO: Found listing with ID: NF06538
2026-03-28 12:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF06538%27 HTTP/1.1" 200 None
2026-03-28 12:08:45 [auto1.it] INFO: Scrape type for NF06538: 0
2026-03-28 12:08:45 [auto1.it] INFO: Found listing with ID: XD75344
2026-03-28 12:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD75344%27 HTTP/1.1" 200 None
2026-03-28 12:08:45 [auto1.it] INFO: Scrape type for XD75344: 0
2026-03-28 12:08:45 [auto1.it] INFO: Found listing with ID: WV36491
2026-03-28 12:08:45 [auto1.it] INFO: Found listing with ID: HR62667
2026-03-28 12:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR62667%27 HTTP/1.1" 200 None
2026-03-28 12:08:45 [auto1.it] INFO: Scrape type for HR62667: 0
2026-03-28 12:08:45 [auto1.it] INFO: Found listing with ID: NG38983
2026-03-28 12:08:45 [auto1.it] INFO: Found listing with ID: GT34435
2026-03-28 12:08:45 [auto1.it] INFO: Found listing with ID: DM32670
2026-03-28 12:08:45 [auto1.it] INFO: Found listing with ID: SM92282
2026-03-28 12:08:45 [auto1.it] INFO: Found listing with ID: LF83969
2026-03-28 12:08:45 [auto1.it] INFO: Found listing with ID: YA27066
2026-03-28 12:08:45 [auto1.it] INFO: Found listing with ID: GF32219
2026-03-28 12:08:45 [auto1.it] INFO: Found listing with ID: WW13816
2026-03-28 12:08:45 [auto1.it] INFO: Found listing with ID: KW05782
2026-03-28 12:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW05782%27 HTTP/1.1" 200 None
2026-03-28 12:08:45 [auto1.it] INFO: Scrape type for KW05782: 0
2026-03-28 12:08:45 [auto1.it] INFO: Found listing with ID: FM41301
2026-03-28 12:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:08:46 [auto1.it] INFO: Channel: 24h | Page: 44 | totalHits: 3675 | hits on page: 40
2026-03-28 12:08:46 [auto1.it] INFO: Found listing with ID: PV36445
2026-03-28 12:08:46 [auto1.it] INFO: Found listing with ID: JE16682
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE16682%27 HTTP/1.1" 200 None
2026-03-28 12:08:46 [auto1.it] INFO: Scrape type for JE16682: 0
2026-03-28 12:08:46 [auto1.it] INFO: Found listing with ID: PY44760
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY44760%27 HTTP/1.1" 200 None
2026-03-28 12:08:46 [auto1.it] INFO: Scrape type for PY44760: 0
2026-03-28 12:08:46 [auto1.it] INFO: Found listing with ID: YA27479
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA27479%27 HTTP/1.1" 200 None
2026-03-28 12:08:46 [auto1.it] INFO: Scrape type for YA27479: 0
2026-03-28 12:08:46 [auto1.it] INFO: Found listing with ID: GP83867
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GP83867%27 HTTP/1.1" 200 None
2026-03-28 12:08:46 [auto1.it] INFO: Scrape type for GP83867: 0
2026-03-28 12:08:46 [auto1.it] INFO: Found listing with ID: RK56494
2026-03-28 12:08:46 [auto1.it] INFO: Found listing with ID: FS14402
2026-03-28 12:08:46 [auto1.it] INFO: Found listing with ID: AS05452
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AS05452%27 HTTP/1.1" 200 None
2026-03-28 12:08:46 [auto1.it] INFO: Scrape type for AS05452: 0
2026-03-28 12:08:46 [auto1.it] INFO: Found listing with ID: ES04012
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES04012%27 HTTP/1.1" 200 None
2026-03-28 12:08:46 [auto1.it] INFO: Scrape type for ES04012: 0
2026-03-28 12:08:46 [auto1.it] INFO: Found listing with ID: LZ09270
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ09270%27 HTTP/1.1" 200 None
2026-03-28 12:08:46 [auto1.it] INFO: Scrape type for LZ09270: 0
2026-03-28 12:08:46 [auto1.it] INFO: Found listing with ID: AS39534
2026-03-28 12:08:46 [auto1.it] INFO: Found listing with ID: DL65362
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL65362%27 HTTP/1.1" 200 None
2026-03-28 12:08:46 [auto1.it] INFO: Scrape type for DL65362: 0
2026-03-28 12:08:46 [auto1.it] INFO: Found listing with ID: EN70026
2026-03-28 12:08:46 [auto1.it] INFO: Found listing with ID: XT78781
2026-03-28 12:08:46 [auto1.it] INFO: Found listing with ID: CZ95838
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ95838%27 HTTP/1.1" 200 None
2026-03-28 12:08:46 [auto1.it] INFO: Scrape type for CZ95838: 0
2026-03-28 12:08:46 [auto1.it] INFO: Found listing with ID: LZ34680
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ34680%27 HTTP/1.1" 200 None
2026-03-28 12:08:46 [auto1.it] INFO: Scrape type for LZ34680: 0
2026-03-28 12:08:46 [auto1.it] INFO: Found listing with ID: AN40699
2026-03-28 12:08:46 [auto1.it] INFO: Found listing with ID: UC06691
2026-03-28 12:08:46 [auto1.it] INFO: Found listing with ID: ZH38248
2026-03-28 12:08:46 [auto1.it] INFO: Found listing with ID: DZ90619
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ90619%27 HTTP/1.1" 200 None
2026-03-28 12:08:46 [auto1.it] INFO: Scrape type for DZ90619: 0
2026-03-28 12:08:46 [auto1.it] INFO: Found listing with ID: CE26038
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE26038%27 HTTP/1.1" 200 None
2026-03-28 12:08:46 [auto1.it] INFO: Scrape type for CE26038: 0
2026-03-28 12:08:46 [auto1.it] INFO: Found listing with ID: NB63581
2026-03-28 12:08:46 [auto1.it] INFO: Found listing with ID: VM26372
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM26372%27 HTTP/1.1" 200 None
2026-03-28 12:08:46 [auto1.it] INFO: Scrape type for VM26372: 0
2026-03-28 12:08:46 [auto1.it] INFO: Found listing with ID: NL15395
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL15395%27 HTTP/1.1" 200 None
2026-03-28 12:08:46 [auto1.it] INFO: Scrape type for NL15395: 0
2026-03-28 12:08:46 [auto1.it] INFO: Found listing with ID: BG87604
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG87604%27 HTTP/1.1" 200 None
2026-03-28 12:08:46 [auto1.it] INFO: Scrape type for BG87604: 0
2026-03-28 12:08:46 [auto1.it] INFO: Found listing with ID: LZ35961
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ35961%27 HTTP/1.1" 200 None
2026-03-28 12:08:46 [auto1.it] INFO: Scrape type for LZ35961: 0
2026-03-28 12:08:46 [auto1.it] INFO: Found listing with ID: YT66548
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT66548%27 HTTP/1.1" 200 None
2026-03-28 12:08:46 [auto1.it] INFO: Scrape type for YT66548: 2
2026-03-28 12:08:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7df95c0-4a32-54fb-aba5-57604471ac64 with identifier: YT66548
2026-03-28 12:08:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7df95c0-4a32-54fb-aba5-57604471ac64 with scrape type 2
2026-03-28 12:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7df95c0-4a32-54fb-aba5-57604471ac64 with scrape type 2
2026-03-28 12:08:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a7df95c0-4a32-54fb-aba5-57604471ac64, identifier: YT66548
2026-03-28 12:08:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a7df95c0-4a32-54fb-aba5-57604471ac64 with identifier: YT66548
2026-03-28 12:08:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a7df95c0-4a32-54fb-aba5-57604471ac64 with identifier: YT66548
2026-03-28 12:08:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a7df95c0-4a32-54fb-aba5-57604471ac64 with identifier: YT66548 to the API
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 525,
 'expiration_date': '2026-03-28T16:09:54Z',
 'fuel_type': 'petrol',
 'id': 'a7df95c0-4a32-54fb-aba5-57604471ac64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT66548',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 102303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-03',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 63 AMG',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 12:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT66548%27 HTTP/1.1" 200 None
2026-03-28 12:08:47 [auto1.it] INFO: Saving data for YT66548: {'auction_closing_time': 1774714194.0, 'created_time': 1774516006.193974, 'last_price_update_time': 1774699727.039168}
2026-03-28 12:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YT66548') HTTP/1.1" 204 0
2026-03-28 12:08:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:08:47 [auto1.it] INFO: Found listing with ID: AZ05187
2026-03-28 12:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ05187%27 HTTP/1.1" 200 None
2026-03-28 12:08:47 [auto1.it] INFO: Scrape type for AZ05187: 0
2026-03-28 12:08:47 [auto1.it] INFO: Found listing with ID: WS24501
2026-03-28 12:08:47 [auto1.it] INFO: Found listing with ID: NR87302
2026-03-28 12:08:47 [auto1.it] INFO: Found listing with ID: ML34451
2026-03-28 12:08:47 [auto1.it] INFO: Found listing with ID: ZS54460
2026-03-28 12:08:47 [auto1.it] INFO: Found listing with ID: KC88593
2026-03-28 12:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC88593%27 HTTP/1.1" 200 None
2026-03-28 12:08:47 [auto1.it] INFO: Scrape type for KC88593: 0
2026-03-28 12:08:47 [auto1.it] INFO: Found listing with ID: JH12834
2026-03-28 12:08:47 [auto1.it] INFO: Found listing with ID: UH56050
2026-03-28 12:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH56050%27 HTTP/1.1" 200 None
2026-03-28 12:08:47 [auto1.it] INFO: Scrape type for UH56050: 0
2026-03-28 12:08:47 [auto1.it] INFO: Found listing with ID: VE88440
2026-03-28 12:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VE88440%27 HTTP/1.1" 200 None
2026-03-28 12:08:47 [auto1.it] INFO: Scrape type for VE88440: 0
2026-03-28 12:08:47 [auto1.it] INFO: Found listing with ID: WS26494
2026-03-28 12:08:47 [auto1.it] INFO: Found listing with ID: VK91535
2026-03-28 12:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK91535%27 HTTP/1.1" 200 None
2026-03-28 12:08:47 [auto1.it] INFO: Scrape type for VK91535: 0
2026-03-28 12:08:47 [auto1.it] INFO: Found listing with ID: BF34891
2026-03-28 12:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF34891%27 HTTP/1.1" 200 None
2026-03-28 12:08:47 [auto1.it] INFO: Scrape type for BF34891: 0
2026-03-28 12:08:47 [auto1.it] INFO: Found listing with ID: FJ33750
2026-03-28 12:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:08:48 [auto1.it] INFO: Channel: 24h | Page: 45 | totalHits: 3675 | hits on page: 40
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: XN46207
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN46207%27 HTTP/1.1" 200 None
2026-03-28 12:08:48 [auto1.it] INFO: Scrape type for XN46207: 0
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: NF47535
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF47535%27 HTTP/1.1" 200 None
2026-03-28 12:08:48 [auto1.it] INFO: Scrape type for NF47535: 0
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: AW83777
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW83777%27 HTTP/1.1" 200 None
2026-03-28 12:08:48 [auto1.it] INFO: Scrape type for AW83777: 0
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: UN97193
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: MN57252
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: TZ83708
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: KZ82470
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: MW18742
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: FC02474
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: JA78037
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: BN58540
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN58540%27 HTTP/1.1" 200 None
2026-03-28 12:08:48 [auto1.it] INFO: Scrape type for BN58540: 0
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: FU65166
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU65166%27 HTTP/1.1" 200 None
2026-03-28 12:08:48 [auto1.it] INFO: Scrape type for FU65166: 0
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: YV43254
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV43254%27 HTTP/1.1" 200 None
2026-03-28 12:08:48 [auto1.it] INFO: Scrape type for YV43254: 0
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: CA25129
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: CE40479
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE40479%27 HTTP/1.1" 200 None
2026-03-28 12:08:48 [auto1.it] INFO: Scrape type for CE40479: 0
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: WT36822
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: HN39146
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HN39146%27 HTTP/1.1" 200 None
2026-03-28 12:08:48 [auto1.it] INFO: Scrape type for HN39146: 0
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: DK95010
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: ZT62923
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT62923%27 HTTP/1.1" 200 None
2026-03-28 12:08:48 [auto1.it] INFO: Scrape type for ZT62923: 0
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: MV32158
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: RV46359
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: VX22650
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX22650%27 HTTP/1.1" 200 None
2026-03-28 12:08:48 [auto1.it] INFO: Scrape type for VX22650: 0
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: UV86732
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UV86732%27 HTTP/1.1" 200 None
2026-03-28 12:08:48 [auto1.it] INFO: Scrape type for UV86732: 0
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: LR88611
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR88611%27 HTTP/1.1" 200 None
2026-03-28 12:08:48 [auto1.it] INFO: Scrape type for LR88611: 0
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: KC34999
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: YG71564
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: SU56229
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SU56229%27 HTTP/1.1" 200 None
2026-03-28 12:08:48 [auto1.it] INFO: Scrape type for SU56229: 0
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: FJ79920
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ79920%27 HTTP/1.1" 200 None
2026-03-28 12:08:48 [auto1.it] INFO: Scrape type for FJ79920: 0
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: LN35929
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN35929%27 HTTP/1.1" 200 None
2026-03-28 12:08:48 [auto1.it] INFO: Scrape type for LN35929: 0
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: VS62042
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS62042%27 HTTP/1.1" 200 None
2026-03-28 12:08:48 [auto1.it] INFO: Scrape type for VS62042: 0
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: VR29883
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VR29883%27 HTTP/1.1" 200 None
2026-03-28 12:08:48 [auto1.it] INFO: Scrape type for VR29883: 0
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: CR81411
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: PS88419
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PS88419%27 HTTP/1.1" 200 None
2026-03-28 12:08:48 [auto1.it] INFO: Scrape type for PS88419: 0
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: HP97671
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: NP87622
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: UA26994
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA26994%27 HTTP/1.1" 200 None
2026-03-28 12:08:48 [auto1.it] INFO: Scrape type for UA26994: 0
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: AM15207
2026-03-28 12:08:48 [auto1.it] INFO: Found listing with ID: ZP66852
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP66852%27 HTTP/1.1" 200 None
2026-03-28 12:08:48 [auto1.it] INFO: Scrape type for ZP66852: 2
2026-03-28 12:08:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac8d882c-e9a2-5b42-8b66-3a5ec003f78a with identifier: ZP66852
2026-03-28 12:08:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac8d882c-e9a2-5b42-8b66-3a5ec003f78a with scrape type 2
2026-03-28 12:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac8d882c-e9a2-5b42-8b66-3a5ec003f78a with scrape type 2
2026-03-28 12:08:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ac8d882c-e9a2-5b42-8b66-3a5ec003f78a, identifier: ZP66852
2026-03-28 12:08:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ac8d882c-e9a2-5b42-8b66-3a5ec003f78a with identifier: ZP66852
2026-03-28 12:08:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ac8d882c-e9a2-5b42-8b66-3a5ec003f78a with identifier: ZP66852
2026-03-28 12:08:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ac8d882c-e9a2-5b42-8b66-3a5ec003f78a with identifier: ZP66852 to the API
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:53:40Z',
 'fuel_type': 'petrol',
 'id': 'ac8d882c-e9a2-5b42-8b66-3a5ec003f78a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP66852',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Courier',
 'odometer': 20108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-11-04',
 'seller_name': None,
 'title': 'Ford Tourneo Courier 1.0 EcoBoost Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2024}
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP66852%27 HTTP/1.1" 200 None
2026-03-28 12:08:48 [auto1.it] INFO: Saving data for ZP66852: {'auction_closing_time': 1774716820.0, 'created_time': 1772090082.560962, 'last_price_update_time': 1774699728.98502}
2026-03-28 12:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZP66852') HTTP/1.1" 204 0
2026-03-28 12:08:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:08:49 [auto1.it] INFO: Found listing with ID: AJ97294
2026-03-28 12:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AJ97294%27 HTTP/1.1" 200 None
2026-03-28 12:08:49 [auto1.it] INFO: Scrape type for AJ97294: 2
2026-03-28 12:08:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c92d56a6-82ad-5701-be38-4133059fb61d with identifier: AJ97294
2026-03-28 12:08:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c92d56a6-82ad-5701-be38-4133059fb61d with scrape type 2
2026-03-28 12:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c92d56a6-82ad-5701-be38-4133059fb61d with scrape type 2
2026-03-28 12:08:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c92d56a6-82ad-5701-be38-4133059fb61d, identifier: AJ97294
2026-03-28 12:08:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c92d56a6-82ad-5701-be38-4133059fb61d with identifier: AJ97294
2026-03-28 12:08:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c92d56a6-82ad-5701-be38-4133059fb61d with identifier: AJ97294
2026-03-28 12:08:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c92d56a6-82ad-5701-be38-4133059fb61d with identifier: AJ97294 to the API
2026-03-28 12:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:19:34Z',
 'fuel_type': 'diesel',
 'id': 'c92d56a6-82ad-5701-be38-4133059fb61d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ97294',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 45225,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-01',
 'seller_name': None,
 'title': 'Audi Q2 30 TDI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2023}
2026-03-28 12:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AJ97294%27 HTTP/1.1" 200 None
2026-03-28 12:08:49 [auto1.it] INFO: Saving data for AJ97294: {'auction_closing_time': 1774714774.0, 'created_time': 1773130053.63155, 'last_price_update_time': 1774699729.557055}
2026-03-28 12:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AJ97294') HTTP/1.1" 204 0
2026-03-28 12:08:49 [auto1.it] INFO: Found listing with ID: SW80726
2026-03-28 12:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SW80726%27 HTTP/1.1" 200 None
2026-03-28 12:08:49 [auto1.it] INFO: Scrape type for SW80726: 0
2026-03-28 12:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:08:50 [auto1.it] INFO: Channel: 24h | Page: 46 | totalHits: 3675 | hits on page: 40
2026-03-28 12:08:50 [auto1.it] INFO: Found listing with ID: MA64070
2026-03-28 12:08:50 [auto1.it] INFO: Found listing with ID: EM71095
2026-03-28 12:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EM71095%27 HTTP/1.1" 200 None
2026-03-28 12:08:50 [auto1.it] INFO: Scrape type for EM71095: 2
2026-03-28 12:08:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f9618b7-c422-5744-987e-21b407cfffba with identifier: EM71095
2026-03-28 12:08:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f9618b7-c422-5744-987e-21b407cfffba with scrape type 2
2026-03-28 12:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f9618b7-c422-5744-987e-21b407cfffba with scrape type 2
2026-03-28 12:08:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2f9618b7-c422-5744-987e-21b407cfffba, identifier: EM71095
2026-03-28 12:08:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2f9618b7-c422-5744-987e-21b407cfffba with identifier: EM71095
2026-03-28 12:08:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2f9618b7-c422-5744-987e-21b407cfffba with identifier: EM71095
2026-03-28 12:08:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2f9618b7-c422-5744-987e-21b407cfffba with identifier: EM71095 to the API
2026-03-28 12:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:03:09Z',
 'fuel_type': 'diesel',
 'id': '2f9618b7-c422-5744-987e-21b407cfffba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM71095',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 152220,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-28',
 'seller_name': None,
 'title': 'Seat Ibiza 1.9 TDI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2006}
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EM71095%27 HTTP/1.1" 200 None
2026-03-28 12:08:51 [auto1.it] INFO: Saving data for EM71095: {'auction_closing_time': 1774713789.0, 'created_time': 1773954405.712826, 'last_price_update_time': 1774699731.162283}
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EM71095') HTTP/1.1" 204 0
2026-03-28 12:08:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:08:51 [auto1.it] INFO: Found listing with ID: VS38043
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS38043%27 HTTP/1.1" 200 None
2026-03-28 12:08:51 [auto1.it] INFO: Scrape type for VS38043: 0
2026-03-28 12:08:51 [auto1.it] INFO: Found listing with ID: JW99626
2026-03-28 12:08:51 [auto1.it] INFO: Found listing with ID: MK90568
2026-03-28 12:08:51 [auto1.it] INFO: Found listing with ID: JX77984
2026-03-28 12:08:51 [auto1.it] INFO: Found listing with ID: PA30121
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA30121%27 HTTP/1.1" 200 None
2026-03-28 12:08:51 [auto1.it] INFO: Scrape type for PA30121: 0
2026-03-28 12:08:51 [auto1.it] INFO: Found listing with ID: HJ68479
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HJ68479%27 HTTP/1.1" 200 None
2026-03-28 12:08:51 [auto1.it] INFO: Scrape type for HJ68479: 0
2026-03-28 12:08:51 [auto1.it] INFO: Found listing with ID: GK89586
2026-03-28 12:08:51 [auto1.it] INFO: Found listing with ID: GT17174
2026-03-28 12:08:51 [auto1.it] INFO: Found listing with ID: RE49156
2026-03-28 12:08:51 [auto1.it] INFO: Found listing with ID: CJ22760
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CJ22760%27 HTTP/1.1" 200 None
2026-03-28 12:08:51 [auto1.it] INFO: Scrape type for CJ22760: 0
2026-03-28 12:08:51 [auto1.it] INFO: Found listing with ID: FW39632
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FW39632%27 HTTP/1.1" 200 None
2026-03-28 12:08:51 [auto1.it] INFO: Scrape type for FW39632: 0
2026-03-28 12:08:51 [auto1.it] INFO: Found listing with ID: JA96150
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA96150%27 HTTP/1.1" 200 None
2026-03-28 12:08:51 [auto1.it] INFO: Scrape type for JA96150: 0
2026-03-28 12:08:51 [auto1.it] INFO: Found listing with ID: EG94847
2026-03-28 12:08:51 [auto1.it] INFO: Found listing with ID: SN82896
2026-03-28 12:08:51 [auto1.it] INFO: Found listing with ID: DC70843
2026-03-28 12:08:51 [auto1.it] INFO: Found listing with ID: VL00110
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VL00110%27 HTTP/1.1" 200 None
2026-03-28 12:08:51 [auto1.it] INFO: Scrape type for VL00110: 0
2026-03-28 12:08:51 [auto1.it] INFO: Found listing with ID: ZT47825
2026-03-28 12:08:51 [auto1.it] INFO: Found listing with ID: PZ52639
2026-03-28 12:08:51 [auto1.it] INFO: Found listing with ID: HS75428
2026-03-28 12:08:51 [auto1.it] INFO: Found listing with ID: MZ40359
2026-03-28 12:08:51 [auto1.it] INFO: Found listing with ID: ZM41579
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM41579%27 HTTP/1.1" 200 None
2026-03-28 12:08:51 [auto1.it] INFO: Scrape type for ZM41579: 0
2026-03-28 12:08:51 [auto1.it] INFO: Found listing with ID: SA83411
2026-03-28 12:08:51 [auto1.it] INFO: Found listing with ID: PT34479
2026-03-28 12:08:51 [auto1.it] INFO: Found listing with ID: SE61764
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE61764%27 HTTP/1.1" 200 None
2026-03-28 12:08:51 [auto1.it] INFO: Scrape type for SE61764: 0
2026-03-28 12:08:51 [auto1.it] INFO: Found listing with ID: GT94067
2026-03-28 12:08:51 [auto1.it] INFO: Found listing with ID: YR30940
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR30940%27 HTTP/1.1" 200 None
2026-03-28 12:08:51 [auto1.it] INFO: Scrape type for YR30940: 0
2026-03-28 12:08:51 [auto1.it] INFO: Found listing with ID: AK38143
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK38143%27 HTTP/1.1" 200 None
2026-03-28 12:08:51 [auto1.it] INFO: Scrape type for AK38143: 0
2026-03-28 12:08:51 [auto1.it] INFO: Found listing with ID: JW87652
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JW87652%27 HTTP/1.1" 200 None
2026-03-28 12:08:51 [auto1.it] INFO: Scrape type for JW87652: 0
2026-03-28 12:08:51 [auto1.it] INFO: Found listing with ID: MP39083
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP39083%27 HTTP/1.1" 200 None
2026-03-28 12:08:51 [auto1.it] INFO: Scrape type for MP39083: 2
2026-03-28 12:08:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c97be62e-07af-5cea-a500-0b4955200a42 with identifier: MP39083
2026-03-28 12:08:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c97be62e-07af-5cea-a500-0b4955200a42 with scrape type 2
2026-03-28 12:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c97be62e-07af-5cea-a500-0b4955200a42 with scrape type 2
2026-03-28 12:08:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c97be62e-07af-5cea-a500-0b4955200a42, identifier: MP39083
2026-03-28 12:08:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c97be62e-07af-5cea-a500-0b4955200a42 with identifier: MP39083
2026-03-28 12:08:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c97be62e-07af-5cea-a500-0b4955200a42 with identifier: MP39083
2026-03-28 12:08:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c97be62e-07af-5cea-a500-0b4955200a42 with identifier: MP39083 to the API
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:18:58Z',
 'fuel_type': 'diesel',
 'id': 'c97be62e-07af-5cea-a500-0b4955200a42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP39083',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 227856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-23',
 'seller_name': None,
 'title': 'Peugeot 3008 2.0 HDi Platinum',
 'transmission': 'manual',
 'trim': 'Platinum',
 'year': 2010}
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP39083%27 HTTP/1.1" 200 None
2026-03-28 12:08:51 [auto1.it] INFO: Saving data for MP39083: {'auction_closing_time': 1774714738.0, 'created_time': 1774516014.377697, 'last_price_update_time': 1774699731.792591}
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MP39083') HTTP/1.1" 204 0
2026-03-28 12:08:51 [auto1.it] INFO: Found listing with ID: WA88594
2026-03-28 12:08:51 [auto1.it] INFO: Found listing with ID: AB27161
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB27161%27 HTTP/1.1" 200 None
2026-03-28 12:08:51 [auto1.it] INFO: Scrape type for AB27161: 2
2026-03-28 12:08:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 124f9fb8-9393-51d4-a0cb-01cc60b0ada0 with identifier: AB27161
2026-03-28 12:08:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 124f9fb8-9393-51d4-a0cb-01cc60b0ada0 with scrape type 2
2026-03-28 12:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 124f9fb8-9393-51d4-a0cb-01cc60b0ada0 with scrape type 2
2026-03-28 12:08:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 124f9fb8-9393-51d4-a0cb-01cc60b0ada0, identifier: AB27161
2026-03-28 12:08:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 124f9fb8-9393-51d4-a0cb-01cc60b0ada0 with identifier: AB27161
2026-03-28 12:08:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 124f9fb8-9393-51d4-a0cb-01cc60b0ada0 with identifier: AB27161
2026-03-28 12:08:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 124f9fb8-9393-51d4-a0cb-01cc60b0ada0 with identifier: AB27161 to the API
2026-03-28 12:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:30:01Z',
 'fuel_type': 'petrol',
 'id': '124f9fb8-9393-51d4-a0cb-01cc60b0ada0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB27161',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'iQ',
 'odometer': 64620,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-27',
 'seller_name': None,
 'title': 'Toyota iQ 1.0 VVT-i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 12:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB27161%27 HTTP/1.1" 200 None
2026-03-28 12:08:52 [auto1.it] INFO: Saving data for AB27161: {'auction_closing_time': 1774715401.0, 'created_time': 1774516050.166972, 'last_price_update_time': 1774699732.280222}
2026-03-28 12:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AB27161') HTTP/1.1" 204 0
2026-03-28 12:08:52 [auto1.it] INFO: Found listing with ID: NN45257
2026-03-28 12:08:52 [auto1.it] INFO: Found listing with ID: JV66530
2026-03-28 12:08:52 [auto1.it] INFO: Found listing with ID: JV92399
2026-03-28 12:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV92399%27 HTTP/1.1" 200 None
2026-03-28 12:08:52 [auto1.it] INFO: Scrape type for JV92399: 0
2026-03-28 12:08:52 [auto1.it] INFO: Found listing with ID: FP63529
2026-03-28 12:08:52 [auto1.it] INFO: Found listing with ID: GD26025
2026-03-28 12:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD26025%27 HTTP/1.1" 200 None
2026-03-28 12:08:52 [auto1.it] INFO: Scrape type for GD26025: 0
2026-03-28 12:08:52 [auto1.it] INFO: Found listing with ID: DG54117
2026-03-28 12:08:52 [auto1.it] INFO: Found listing with ID: LC35627
2026-03-28 12:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:08:53 [auto1.it] INFO: Channel: 24h | Page: 47 | totalHits: 3675 | hits on page: 40
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: GE96866
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GE96866%27 HTTP/1.1" 200 None
2026-03-28 12:08:53 [auto1.it] INFO: Scrape type for GE96866: 0
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: YT54925
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT54925%27 HTTP/1.1" 200 None
2026-03-28 12:08:53 [auto1.it] INFO: Scrape type for YT54925: 0
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: RN34673
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN34673%27 HTTP/1.1" 200 None
2026-03-28 12:08:53 [auto1.it] INFO: Scrape type for RN34673: 0
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: MR41650
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: VF40015
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: WB49525
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB49525%27 HTTP/1.1" 200 None
2026-03-28 12:08:53 [auto1.it] INFO: Scrape type for WB49525: 0
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: CG39914
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: KD78044
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: PH76883
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PH76883%27 HTTP/1.1" 200 None
2026-03-28 12:08:53 [auto1.it] INFO: Scrape type for PH76883: 0
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: PL46674
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: SJ27084
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: XT06455
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT06455%27 HTTP/1.1" 200 None
2026-03-28 12:08:53 [auto1.it] INFO: Scrape type for XT06455: 0
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: YR22180
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR22180%27 HTTP/1.1" 200 None
2026-03-28 12:08:53 [auto1.it] INFO: Scrape type for YR22180: 0
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: DU27082
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU27082%27 HTTP/1.1" 200 None
2026-03-28 12:08:53 [auto1.it] INFO: Scrape type for DU27082: 0
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: AH76679
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: ZS91075
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: GJ69248
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ69248%27 HTTP/1.1" 200 None
2026-03-28 12:08:53 [auto1.it] INFO: Scrape type for GJ69248: 0
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: RH51266
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: HH67812
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: FF98619
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: PD61246
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: AN46141
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: VY12867
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: NP19925
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: GP32849
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: RG23044
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG23044%27 HTTP/1.1" 200 None
2026-03-28 12:08:53 [auto1.it] INFO: Scrape type for RG23044: 0
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: PE03343
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: NC40954
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: JS86571
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS86571%27 HTTP/1.1" 200 None
2026-03-28 12:08:53 [auto1.it] INFO: Scrape type for JS86571: 0
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: SW25122
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SW25122%27 HTTP/1.1" 200 None
2026-03-28 12:08:53 [auto1.it] INFO: Scrape type for SW25122: 0
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: ZH41426
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: EL59293
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EL59293%27 HTTP/1.1" 200 None
2026-03-28 12:08:53 [auto1.it] INFO: Scrape type for EL59293: 0
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: WR52243
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: RX05887
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX05887%27 HTTP/1.1" 200 None
2026-03-28 12:08:53 [auto1.it] INFO: Scrape type for RX05887: 0
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: NF99780
2026-03-28 12:08:53 [auto1.it] INFO: Found listing with ID: UY31632
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY31632%27 HTTP/1.1" 200 None
2026-03-28 12:08:53 [auto1.it] INFO: Scrape type for UY31632: 2
2026-03-28 12:08:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c79a66a7-cad8-5210-91e4-e50e65670448 with identifier: UY31632
2026-03-28 12:08:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c79a66a7-cad8-5210-91e4-e50e65670448 with scrape type 2
2026-03-28 12:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c79a66a7-cad8-5210-91e4-e50e65670448 with scrape type 2
2026-03-28 12:08:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c79a66a7-cad8-5210-91e4-e50e65670448, identifier: UY31632
2026-03-28 12:08:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c79a66a7-cad8-5210-91e4-e50e65670448 with identifier: UY31632
2026-03-28 12:08:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c79a66a7-cad8-5210-91e4-e50e65670448 with identifier: UY31632
2026-03-28 12:08:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c79a66a7-cad8-5210-91e4-e50e65670448 with identifier: UY31632 to the API
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:09:44Z',
 'fuel_type': 'diesel',
 'id': 'c79a66a7-cad8-5210-91e4-e50e65670448',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY31632',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 266083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-13',
 'seller_name': None,
 'title': 'Kia Sportage 2.0 CRDi Rebel 4WD',
 'transmission': 'manual',
 'trim': 'Rebel 4WD',
 'year': 2013}
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY31632%27 HTTP/1.1" 200 None
2026-03-28 12:08:53 [auto1.it] INFO: Saving data for UY31632: {'auction_closing_time': 1774714184.0, 'created_time': 1774515993.15199, 'last_price_update_time': 1774699733.934211}
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UY31632') HTTP/1.1" 204 0
2026-03-28 12:08:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:08:54 [auto1.it] INFO: Found listing with ID: DV60834
2026-03-28 12:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV60834%27 HTTP/1.1" 200 None
2026-03-28 12:08:54 [auto1.it] INFO: Scrape type for DV60834: 0
2026-03-28 12:08:54 [auto1.it] INFO: Found listing with ID: FN63794
2026-03-28 12:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN63794%27 HTTP/1.1" 200 None
2026-03-28 12:08:54 [auto1.it] INFO: Scrape type for FN63794: 0
2026-03-28 12:08:54 [auto1.it] INFO: Found listing with ID: ZC00549
2026-03-28 12:08:54 [auto1.it] INFO: Found listing with ID: TB04620
2026-03-28 12:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:08:58 [auto1.it] INFO: Channel: 24h | Page: 48 | totalHits: 3675 | hits on page: 40
2026-03-28 12:08:58 [auto1.it] INFO: Found listing with ID: NJ73400
2026-03-28 12:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NJ73400%27 HTTP/1.1" 200 None
2026-03-28 12:08:58 [auto1.it] INFO: Scrape type for NJ73400: 0
2026-03-28 12:08:58 [auto1.it] INFO: Found listing with ID: TH32608
2026-03-28 12:08:58 [auto1.it] INFO: Found listing with ID: ZB01532
2026-03-28 12:08:58 [auto1.it] INFO: Found listing with ID: LY23963
2026-03-28 12:08:58 [auto1.it] INFO: Found listing with ID: AG78775
2026-03-28 12:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG78775%27 HTTP/1.1" 200 None
2026-03-28 12:08:58 [auto1.it] INFO: Scrape type for AG78775: 0
2026-03-28 12:08:58 [auto1.it] INFO: Found listing with ID: SY65620
2026-03-28 12:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY65620%27 HTTP/1.1" 200 None
2026-03-28 12:08:58 [auto1.it] INFO: Scrape type for SY65620: 0
2026-03-28 12:08:58 [auto1.it] INFO: Found listing with ID: WK43890
2026-03-28 12:08:58 [auto1.it] INFO: Found listing with ID: WL49427
2026-03-28 12:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL49427%27 HTTP/1.1" 200 None
2026-03-28 12:08:58 [auto1.it] INFO: Scrape type for WL49427: 0
2026-03-28 12:08:58 [auto1.it] INFO: Found listing with ID: ZN97405
2026-03-28 12:08:58 [auto1.it] INFO: Found listing with ID: ET23172
2026-03-28 12:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET23172%27 HTTP/1.1" 200 None
2026-03-28 12:08:58 [auto1.it] INFO: Scrape type for ET23172: 0
2026-03-28 12:08:58 [auto1.it] INFO: Found listing with ID: PM46324
2026-03-28 12:08:58 [auto1.it] INFO: Found listing with ID: VG33831
2026-03-28 12:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG33831%27 HTTP/1.1" 200 None
2026-03-28 12:08:58 [auto1.it] INFO: Scrape type for VG33831: 0
2026-03-28 12:08:58 [auto1.it] INFO: Found listing with ID: MX95744
2026-03-28 12:08:58 [auto1.it] INFO: Found listing with ID: NA15959
2026-03-28 12:08:58 [auto1.it] INFO: Found listing with ID: UZ16276
2026-03-28 12:08:58 [auto1.it] INFO: Found listing with ID: PX43587
2026-03-28 12:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PX43587%27 HTTP/1.1" 200 None
2026-03-28 12:08:58 [auto1.it] INFO: Scrape type for PX43587: 0
2026-03-28 12:08:58 [auto1.it] INFO: Found listing with ID: AL00602
2026-03-28 12:08:58 [auto1.it] INFO: Found listing with ID: UY92824
2026-03-28 12:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY92824%27 HTTP/1.1" 200 None
2026-03-28 12:08:58 [auto1.it] INFO: Scrape type for UY92824: 0
2026-03-28 12:08:58 [auto1.it] INFO: Found listing with ID: WK45429
2026-03-28 12:08:58 [auto1.it] INFO: Found listing with ID: VV53069
2026-03-28 12:08:58 [auto1.it] INFO: Found listing with ID: PR60258
2026-03-28 12:08:58 [auto1.it] INFO: Found listing with ID: SM48224
2026-03-28 12:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM48224%27 HTTP/1.1" 200 None
2026-03-28 12:08:58 [auto1.it] INFO: Scrape type for SM48224: 2
2026-03-28 12:08:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c251e13-feb8-5d0c-ac8f-16192e7f74ba with identifier: SM48224
2026-03-28 12:08:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c251e13-feb8-5d0c-ac8f-16192e7f74ba with scrape type 2
2026-03-28 12:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c251e13-feb8-5d0c-ac8f-16192e7f74ba with scrape type 2
2026-03-28 12:08:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7c251e13-feb8-5d0c-ac8f-16192e7f74ba, identifier: SM48224
2026-03-28 12:08:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7c251e13-feb8-5d0c-ac8f-16192e7f74ba with identifier: SM48224
2026-03-28 12:08:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7c251e13-feb8-5d0c-ac8f-16192e7f74ba with identifier: SM48224
2026-03-28 12:08:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7c251e13-feb8-5d0c-ac8f-16192e7f74ba with identifier: SM48224 to the API
2026-03-28 12:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:08:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:08:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:45:06Z',
 'fuel_type': 'diesel',
 'id': '7c251e13-feb8-5d0c-ac8f-16192e7f74ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM48224',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 199338,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-07',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 HSE',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2016}
2026-03-28 12:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM48224%27 HTTP/1.1" 200 None
2026-03-28 12:08:59 [auto1.it] INFO: Saving data for SM48224: {'auction_closing_time': 1774716306.0, 'created_time': 1774516043.267466, 'last_price_update_time': 1774699739.103253}
2026-03-28 12:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SM48224') HTTP/1.1" 204 0
2026-03-28 12:08:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:08:59 [auto1.it] INFO: Found listing with ID: CR59099
2026-03-28 12:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR59099%27 HTTP/1.1" 200 None
2026-03-28 12:08:59 [auto1.it] INFO: Scrape type for CR59099: 0
2026-03-28 12:08:59 [auto1.it] INFO: Found listing with ID: GL14484
2026-03-28 12:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL14484%27 HTTP/1.1" 200 None
2026-03-28 12:08:59 [auto1.it] INFO: Scrape type for GL14484: 0
2026-03-28 12:08:59 [auto1.it] INFO: Found listing with ID: WX74031
2026-03-28 12:08:59 [auto1.it] INFO: Found listing with ID: EU31713
2026-03-28 12:08:59 [auto1.it] INFO: Found listing with ID: PC08204
2026-03-28 12:08:59 [auto1.it] INFO: Found listing with ID: ZR26877
2026-03-28 12:08:59 [auto1.it] INFO: Found listing with ID: TE47770
2026-03-28 12:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TE47770%27 HTTP/1.1" 200 None
2026-03-28 12:08:59 [auto1.it] INFO: Scrape type for TE47770: 0
2026-03-28 12:08:59 [auto1.it] INFO: Found listing with ID: YG22381
2026-03-28 12:08:59 [auto1.it] INFO: Found listing with ID: DD82932
2026-03-28 12:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD82932%27 HTTP/1.1" 200 None
2026-03-28 12:08:59 [auto1.it] INFO: Scrape type for DD82932: 0
2026-03-28 12:08:59 [auto1.it] INFO: Found listing with ID: DM50235
2026-03-28 12:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DM50235%27 HTTP/1.1" 200 None
2026-03-28 12:08:59 [auto1.it] INFO: Scrape type for DM50235: 0
2026-03-28 12:08:59 [auto1.it] INFO: Found listing with ID: MB79295
2026-03-28 12:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB79295%27 HTTP/1.1" 200 None
2026-03-28 12:08:59 [auto1.it] INFO: Scrape type for MB79295: 0
2026-03-28 12:08:59 [auto1.it] INFO: Found listing with ID: CV31826
2026-03-28 12:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV31826%27 HTTP/1.1" 200 None
2026-03-28 12:08:59 [auto1.it] INFO: Scrape type for CV31826: 0
2026-03-28 12:08:59 [auto1.it] INFO: Found listing with ID: FN50437
2026-03-28 12:08:59 [auto1.it] INFO: Found listing with ID: TT40811
2026-03-28 12:08:59 [auto1.it] INFO: Found listing with ID: FJ28833
2026-03-28 12:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ28833%27 HTTP/1.1" 200 None
2026-03-28 12:08:59 [auto1.it] INFO: Scrape type for FJ28833: 0
2026-03-28 12:08:59 [auto1.it] INFO: Found listing with ID: SE98453
2026-03-28 12:08:59 [auto1.it] INFO: Found listing with ID: FL86177
2026-03-28 12:08:59 [auto1.it] INFO: Found listing with ID: MY86461
2026-03-28 12:09:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:09:00 [auto1.it] INFO: Channel: 24h | Page: 49 | totalHits: 3675 | hits on page: 40
2026-03-28 12:09:00 [auto1.it] INFO: Found listing with ID: LK58538
2026-03-28 12:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LK58538%27 HTTP/1.1" 200 None
2026-03-28 12:09:00 [auto1.it] INFO: Scrape type for LK58538: 0
2026-03-28 12:09:00 [auto1.it] INFO: Found listing with ID: FW75708
2026-03-28 12:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FW75708%27 HTTP/1.1" 200 None
2026-03-28 12:09:00 [auto1.it] INFO: Scrape type for FW75708: 0
2026-03-28 12:09:00 [auto1.it] INFO: Found listing with ID: GD10861
2026-03-28 12:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD10861%27 HTTP/1.1" 200 None
2026-03-28 12:09:00 [auto1.it] INFO: Scrape type for GD10861: 0
2026-03-28 12:09:00 [auto1.it] INFO: Found listing with ID: AK03087
2026-03-28 12:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK03087%27 HTTP/1.1" 200 None
2026-03-28 12:09:00 [auto1.it] INFO: Scrape type for AK03087: 0
2026-03-28 12:09:00 [auto1.it] INFO: Found listing with ID: YR57836
2026-03-28 12:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR57836%27 HTTP/1.1" 200 None
2026-03-28 12:09:00 [auto1.it] INFO: Scrape type for YR57836: 2
2026-03-28 12:09:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b109256-57de-5644-9e27-bd34c52be489 with identifier: YR57836
2026-03-28 12:09:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b109256-57de-5644-9e27-bd34c52be489 with scrape type 2
2026-03-28 12:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b109256-57de-5644-9e27-bd34c52be489 with scrape type 2
2026-03-28 12:09:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3b109256-57de-5644-9e27-bd34c52be489, identifier: YR57836
2026-03-28 12:09:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3b109256-57de-5644-9e27-bd34c52be489 with identifier: YR57836
2026-03-28 12:09:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3b109256-57de-5644-9e27-bd34c52be489 with identifier: YR57836
2026-03-28 12:09:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3b109256-57de-5644-9e27-bd34c52be489 with identifier: YR57836 to the API
2026-03-28 12:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:04:05Z',
 'fuel_type': 'diesel',
 'id': '3b109256-57de-5644-9e27-bd34c52be489',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR57836',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 176624,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-25',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 12:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR57836%27 HTTP/1.1" 200 None
2026-03-28 12:09:01 [auto1.it] INFO: Saving data for YR57836: {'auction_closing_time': 1774713845.0, 'created_time': 1774094836.588432, 'last_price_update_time': 1774699741.137054}
2026-03-28 12:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YR57836') HTTP/1.1" 204 0
2026-03-28 12:09:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:09:01 [auto1.it] INFO: Found listing with ID: PG69146
2026-03-28 12:09:01 [auto1.it] INFO: Found listing with ID: VY17663
2026-03-28 12:09:01 [auto1.it] INFO: Found listing with ID: PW49149
2026-03-28 12:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW49149%27 HTTP/1.1" 200 None
2026-03-28 12:09:01 [auto1.it] INFO: Scrape type for PW49149: 0
2026-03-28 12:09:01 [auto1.it] INFO: Found listing with ID: SN43721
2026-03-28 12:09:01 [auto1.it] INFO: Found listing with ID: DB80555
2026-03-28 12:09:01 [auto1.it] INFO: Found listing with ID: KL59990
2026-03-28 12:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL59990%27 HTTP/1.1" 200 None
2026-03-28 12:09:01 [auto1.it] INFO: Scrape type for KL59990: 2
2026-03-28 12:09:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0ebc7c8-be58-5316-8abb-13931d4c95a3 with identifier: KL59990
2026-03-28 12:09:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0ebc7c8-be58-5316-8abb-13931d4c95a3 with scrape type 2
2026-03-28 12:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0ebc7c8-be58-5316-8abb-13931d4c95a3 with scrape type 2
2026-03-28 12:09:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f0ebc7c8-be58-5316-8abb-13931d4c95a3, identifier: KL59990
2026-03-28 12:09:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f0ebc7c8-be58-5316-8abb-13931d4c95a3 with identifier: KL59990
2026-03-28 12:09:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f0ebc7c8-be58-5316-8abb-13931d4c95a3 with identifier: KL59990
2026-03-28 12:09:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f0ebc7c8-be58-5316-8abb-13931d4c95a3 with identifier: KL59990 to the API
2026-03-28 12:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-28T16:46:31Z',
 'fuel_type': 'hybrid',
 'id': 'f0ebc7c8-be58-5316-8abb-13931d4c95a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL59990',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 68244,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-25',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 Plug-in Hybrid Style 4WD',
 'transmission': 'automatic',
 'trim': 'Style 4WD',
 'year': 2023}
2026-03-28 12:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL59990%27 HTTP/1.1" 200 None
2026-03-28 12:09:01 [auto1.it] INFO: Saving data for KL59990: {'auction_closing_time': 1774716391.0, 'created_time': 1774516021.569804, 'last_price_update_time': 1774699741.661902}
2026-03-28 12:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KL59990') HTTP/1.1" 204 0
2026-03-28 12:09:01 [auto1.it] INFO: Found listing with ID: YG69242
2026-03-28 12:09:01 [auto1.it] INFO: Found listing with ID: UU42512
2026-03-28 12:09:01 [auto1.it] INFO: Found listing with ID: ZY88816
2026-03-28 12:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY88816%27 HTTP/1.1" 200 None
2026-03-28 12:09:01 [auto1.it] INFO: Scrape type for ZY88816: 0
2026-03-28 12:09:01 [auto1.it] INFO: Found listing with ID: KY93059
2026-03-28 12:09:01 [auto1.it] INFO: Found listing with ID: MS58907
2026-03-28 12:09:01 [auto1.it] INFO: Found listing with ID: BP59545
2026-03-28 12:09:01 [auto1.it] INFO: Found listing with ID: HR68731
2026-03-28 12:09:01 [auto1.it] INFO: Found listing with ID: ZL23627
2026-03-28 12:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL23627%27 HTTP/1.1" 200 None
2026-03-28 12:09:01 [auto1.it] INFO: Scrape type for ZL23627: 0
2026-03-28 12:09:01 [auto1.it] INFO: Found listing with ID: GZ48200
2026-03-28 12:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ48200%27 HTTP/1.1" 200 None
2026-03-28 12:09:01 [auto1.it] INFO: Scrape type for GZ48200: 0
2026-03-28 12:09:01 [auto1.it] INFO: Found listing with ID: ZK34576
2026-03-28 12:09:01 [auto1.it] INFO: Found listing with ID: TA76256
2026-03-28 12:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TA76256%27 HTTP/1.1" 200 None
2026-03-28 12:09:01 [auto1.it] INFO: Scrape type for TA76256: 0
2026-03-28 12:09:01 [auto1.it] INFO: Found listing with ID: BA18808
2026-03-28 12:09:01 [auto1.it] INFO: Found listing with ID: HX42058
2026-03-28 12:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HX42058%27 HTTP/1.1" 200 None
2026-03-28 12:09:01 [auto1.it] INFO: Scrape type for HX42058: 2
2026-03-28 12:09:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63390a69-fa10-5880-94da-3cfdcd580634 with identifier: HX42058
2026-03-28 12:09:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63390a69-fa10-5880-94da-3cfdcd580634 with scrape type 2
2026-03-28 12:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63390a69-fa10-5880-94da-3cfdcd580634 with scrape type 2
2026-03-28 12:09:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 63390a69-fa10-5880-94da-3cfdcd580634, identifier: HX42058
2026-03-28 12:09:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 63390a69-fa10-5880-94da-3cfdcd580634 with identifier: HX42058
2026-03-28 12:09:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 63390a69-fa10-5880-94da-3cfdcd580634 with identifier: HX42058
2026-03-28 12:09:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 63390a69-fa10-5880-94da-3cfdcd580634 with identifier: HX42058 to the API
2026-03-28 12:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:16:21Z',
 'fuel_type': 'hybrid',
 'id': '63390a69-fa10-5880-94da-3cfdcd580634',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX42058',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'HR-V',
 'odometer': 11410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-10',
 'seller_name': None,
 'title': 'Honda HR-V 1.5 i-MMD Hybrid Advance',
 'transmission': 'automatic',
 'trim': 'Advance',
 'year': 2024}
2026-03-28 12:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HX42058%27 HTTP/1.1" 200 None
2026-03-28 12:09:02 [auto1.it] INFO: Saving data for HX42058: {'auction_closing_time': 1774714581.0, 'created_time': 1774515991.780573, 'last_price_update_time': 1774699742.152326}
2026-03-28 12:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HX42058') HTTP/1.1" 204 0
2026-03-28 12:09:02 [auto1.it] INFO: Found listing with ID: CM62235
2026-03-28 12:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM62235%27 HTTP/1.1" 200 None
2026-03-28 12:09:02 [auto1.it] INFO: Scrape type for CM62235: 0
2026-03-28 12:09:02 [auto1.it] INFO: Found listing with ID: AL31593
2026-03-28 12:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL31593%27 HTTP/1.1" 200 None
2026-03-28 12:09:02 [auto1.it] INFO: Scrape type for AL31593: 0
2026-03-28 12:09:02 [auto1.it] INFO: Found listing with ID: FZ80781
2026-03-28 12:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FZ80781%27 HTTP/1.1" 200 None
2026-03-28 12:09:02 [auto1.it] INFO: Scrape type for FZ80781: 0
2026-03-28 12:09:02 [auto1.it] INFO: Found listing with ID: EZ33304
2026-03-28 12:09:02 [auto1.it] INFO: Found listing with ID: BG88110
2026-03-28 12:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG88110%27 HTTP/1.1" 200 None
2026-03-28 12:09:02 [auto1.it] INFO: Scrape type for BG88110: 0
2026-03-28 12:09:02 [auto1.it] INFO: Found listing with ID: NH73732
2026-03-28 12:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH73732%27 HTTP/1.1" 200 None
2026-03-28 12:09:02 [auto1.it] INFO: Scrape type for NH73732: 2
2026-03-28 12:09:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f6a969b-7c5f-5b3e-9d2d-4bb3235823f6 with identifier: NH73732
2026-03-28 12:09:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f6a969b-7c5f-5b3e-9d2d-4bb3235823f6 with scrape type 2
2026-03-28 12:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f6a969b-7c5f-5b3e-9d2d-4bb3235823f6 with scrape type 2
2026-03-28 12:09:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8f6a969b-7c5f-5b3e-9d2d-4bb3235823f6, identifier: NH73732
2026-03-28 12:09:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8f6a969b-7c5f-5b3e-9d2d-4bb3235823f6 with identifier: NH73732
2026-03-28 12:09:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8f6a969b-7c5f-5b3e-9d2d-4bb3235823f6 with identifier: NH73732
2026-03-28 12:09:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8f6a969b-7c5f-5b3e-9d2d-4bb3235823f6 with identifier: NH73732 to the API
2026-03-28 12:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:43:44Z',
 'fuel_type': 'petrol',
 'id': '8f6a969b-7c5f-5b3e-9d2d-4bb3235823f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH73732',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 111912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-10',
 'seller_name': None,
 'title': 'Ford Ka 1.2 Plus',
 'transmission': 'manual',
 'trim': 'Plus',
 'year': 2010}
2026-03-28 12:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH73732%27 HTTP/1.1" 200 None
2026-03-28 12:09:02 [auto1.it] INFO: Saving data for NH73732: {'auction_closing_time': 1774716224.0, 'created_time': 1774127139.83587, 'last_price_update_time': 1774699742.736968}
2026-03-28 12:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NH73732') HTTP/1.1" 204 0
2026-03-28 12:09:02 [auto1.it] INFO: Found listing with ID: WT52400
2026-03-28 12:09:02 [auto1.it] INFO: Found listing with ID: PP13796
2026-03-28 12:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP13796%27 HTTP/1.1" 200 None
2026-03-28 12:09:02 [auto1.it] INFO: Scrape type for PP13796: 0
2026-03-28 12:09:02 [auto1.it] INFO: Found listing with ID: PE82748
2026-03-28 12:09:02 [auto1.it] INFO: Found listing with ID: RD42515
2026-03-28 12:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD42515%27 HTTP/1.1" 200 None
2026-03-28 12:09:02 [auto1.it] INFO: Scrape type for RD42515: 0
2026-03-28 12:09:02 [auto1.it] INFO: Found listing with ID: RB40748
2026-03-28 12:09:02 [auto1.it] INFO: Found listing with ID: WK11111
2026-03-28 12:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK11111%27 HTTP/1.1" 200 None
2026-03-28 12:09:02 [auto1.it] INFO: Scrape type for WK11111: 0
2026-03-28 12:09:02 [auto1.it] INFO: Found listing with ID: NR02013
2026-03-28 12:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR02013%27 HTTP/1.1" 200 None
2026-03-28 12:09:02 [auto1.it] INFO: Scrape type for NR02013: 0
2026-03-28 12:09:02 [auto1.it] INFO: Found listing with ID: DP25317
2026-03-28 12:09:02 [auto1.it] INFO: Found listing with ID: RB41794
2026-03-28 12:09:02 [auto1.it] INFO: Found listing with ID: PV17909
2026-03-28 12:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV17909%27 HTTP/1.1" 200 None
2026-03-28 12:09:02 [auto1.it] INFO: Scrape type for PV17909: 0
2026-03-28 12:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:09:03 [auto1.it] INFO: Channel: 24h | Page: 50 | totalHits: 3675 | hits on page: 40
2026-03-28 12:09:03 [auto1.it] INFO: Found listing with ID: FR96632
2026-03-28 12:09:03 [auto1.it] INFO: Found listing with ID: ZK68739
2026-03-28 12:09:03 [auto1.it] INFO: Found listing with ID: JV47316
2026-03-28 12:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV47316%27 HTTP/1.1" 200 None
2026-03-28 12:09:03 [auto1.it] INFO: Scrape type for JV47316: 2
2026-03-28 12:09:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab918ed2-b167-5237-a2c8-8f373b5747df with identifier: JV47316
2026-03-28 12:09:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab918ed2-b167-5237-a2c8-8f373b5747df with scrape type 2
2026-03-28 12:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab918ed2-b167-5237-a2c8-8f373b5747df with scrape type 2
2026-03-28 12:09:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ab918ed2-b167-5237-a2c8-8f373b5747df, identifier: JV47316
2026-03-28 12:09:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ab918ed2-b167-5237-a2c8-8f373b5747df with identifier: JV47316
2026-03-28 12:09:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ab918ed2-b167-5237-a2c8-8f373b5747df with identifier: JV47316
2026-03-28 12:09:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ab918ed2-b167-5237-a2c8-8f373b5747df with identifier: JV47316 to the API
2026-03-28 12:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:00:21Z',
 'fuel_type': 'petrol',
 'id': 'ab918ed2-b167-5237-a2c8-8f373b5747df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV47316',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 13463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-28',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.0 TSI R-Line',
 'transmission': 'manual',
 'trim': 'R-Line',
 'year': 2023}
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV47316%27 HTTP/1.1" 200 None
2026-03-28 12:09:04 [auto1.it] INFO: Saving data for JV47316: {'auction_closing_time': 1774713621.0, 'created_time': 1774515952.676074, 'last_price_update_time': 1774699744.081362}
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JV47316') HTTP/1.1" 204 0
2026-03-28 12:09:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:09:04 [auto1.it] INFO: Found listing with ID: VU35787
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU35787%27 HTTP/1.1" 200 None
2026-03-28 12:09:04 [auto1.it] INFO: Scrape type for VU35787: 0
2026-03-28 12:09:04 [auto1.it] INFO: Found listing with ID: CZ70189
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ70189%27 HTTP/1.1" 200 None
2026-03-28 12:09:04 [auto1.it] INFO: Scrape type for CZ70189: 0
2026-03-28 12:09:04 [auto1.it] INFO: Found listing with ID: MD89845
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD89845%27 HTTP/1.1" 200 None
2026-03-28 12:09:04 [auto1.it] INFO: Scrape type for MD89845: 0
2026-03-28 12:09:04 [auto1.it] INFO: Found listing with ID: JY72806
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JY72806%27 HTTP/1.1" 200 None
2026-03-28 12:09:04 [auto1.it] INFO: Scrape type for JY72806: 0
2026-03-28 12:09:04 [auto1.it] INFO: Found listing with ID: WS96553
2026-03-28 12:09:04 [auto1.it] INFO: Found listing with ID: FE23339
2026-03-28 12:09:04 [auto1.it] INFO: Found listing with ID: PC30910
2026-03-28 12:09:04 [auto1.it] INFO: Found listing with ID: EG37801
2026-03-28 12:09:04 [auto1.it] INFO: Found listing with ID: CS73145
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS73145%27 HTTP/1.1" 200 None
2026-03-28 12:09:04 [auto1.it] INFO: Scrape type for CS73145: 0
2026-03-28 12:09:04 [auto1.it] INFO: Found listing with ID: MB91559
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB91559%27 HTTP/1.1" 200 None
2026-03-28 12:09:04 [auto1.it] INFO: Scrape type for MB91559: 0
2026-03-28 12:09:04 [auto1.it] INFO: Found listing with ID: JE32624
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE32624%27 HTTP/1.1" 200 None
2026-03-28 12:09:04 [auto1.it] INFO: Scrape type for JE32624: 0
2026-03-28 12:09:04 [auto1.it] INFO: Found listing with ID: SX13991
2026-03-28 12:09:04 [auto1.it] INFO: Found listing with ID: JD24635
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD24635%27 HTTP/1.1" 200 None
2026-03-28 12:09:04 [auto1.it] INFO: Scrape type for JD24635: 0
2026-03-28 12:09:04 [auto1.it] INFO: Found listing with ID: NK12319
2026-03-28 12:09:04 [auto1.it] INFO: Found listing with ID: EV42289
2026-03-28 12:09:04 [auto1.it] INFO: Found listing with ID: FH21751
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FH21751%27 HTTP/1.1" 200 None
2026-03-28 12:09:04 [auto1.it] INFO: Scrape type for FH21751: 0
2026-03-28 12:09:04 [auto1.it] INFO: Found listing with ID: LL47627
2026-03-28 12:09:04 [auto1.it] INFO: Found listing with ID: AK61800
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK61800%27 HTTP/1.1" 200 None
2026-03-28 12:09:04 [auto1.it] INFO: Scrape type for AK61800: 0
2026-03-28 12:09:04 [auto1.it] INFO: Found listing with ID: FU99331
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU99331%27 HTTP/1.1" 200 None
2026-03-28 12:09:04 [auto1.it] INFO: Scrape type for FU99331: 0
2026-03-28 12:09:04 [auto1.it] INFO: Found listing with ID: ZJ09783
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ09783%27 HTTP/1.1" 200 None
2026-03-28 12:09:04 [auto1.it] INFO: Scrape type for ZJ09783: 0
2026-03-28 12:09:04 [auto1.it] INFO: Found listing with ID: GF05972
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GF05972%27 HTTP/1.1" 200 None
2026-03-28 12:09:04 [auto1.it] INFO: Scrape type for GF05972: 0
2026-03-28 12:09:04 [auto1.it] INFO: Found listing with ID: KU92785
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KU92785%27 HTTP/1.1" 200 None
2026-03-28 12:09:04 [auto1.it] INFO: Scrape type for KU92785: 0
2026-03-28 12:09:04 [auto1.it] INFO: Found listing with ID: FD98463
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD98463%27 HTTP/1.1" 200 None
2026-03-28 12:09:04 [auto1.it] INFO: Scrape type for FD98463: 0
2026-03-28 12:09:04 [auto1.it] INFO: Found listing with ID: UM22430
2026-03-28 12:09:04 [auto1.it] INFO: Found listing with ID: DT48563
2026-03-28 12:09:04 [auto1.it] INFO: Found listing with ID: LN31957
2026-03-28 12:09:04 [auto1.it] INFO: Found listing with ID: XD93142
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD93142%27 HTTP/1.1" 200 None
2026-03-28 12:09:04 [auto1.it] INFO: Scrape type for XD93142: 0
2026-03-28 12:09:04 [auto1.it] INFO: Found listing with ID: XJ13084
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ13084%27 HTTP/1.1" 200 None
2026-03-28 12:09:04 [auto1.it] INFO: Scrape type for XJ13084: 2
2026-03-28 12:09:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff4068b8-94fe-5c68-8cf4-598f11dd9d2d with identifier: XJ13084
2026-03-28 12:09:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff4068b8-94fe-5c68-8cf4-598f11dd9d2d with scrape type 2
2026-03-28 12:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff4068b8-94fe-5c68-8cf4-598f11dd9d2d with scrape type 2
2026-03-28 12:09:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ff4068b8-94fe-5c68-8cf4-598f11dd9d2d, identifier: XJ13084
2026-03-28 12:09:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ff4068b8-94fe-5c68-8cf4-598f11dd9d2d with identifier: XJ13084
2026-03-28 12:09:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ff4068b8-94fe-5c68-8cf4-598f11dd9d2d with identifier: XJ13084
2026-03-28 12:09:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ff4068b8-94fe-5c68-8cf4-598f11dd9d2d with identifier: XJ13084 to the API
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:13:41Z',
 'fuel_type': 'diesel',
 'id': 'ff4068b8-94fe-5c68-8cf4-598f11dd9d2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ13084',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 73355,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-11',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ13084%27 HTTP/1.1" 200 None
2026-03-28 12:09:04 [auto1.it] INFO: Saving data for XJ13084: {'auction_closing_time': 1774714421.0, 'created_time': 1774515965.721145, 'last_price_update_time': 1774699744.841719}
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XJ13084') HTTP/1.1" 204 0
2026-03-28 12:09:04 [auto1.it] INFO: Found listing with ID: WX11793
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WX11793%27 HTTP/1.1" 200 None
2026-03-28 12:09:04 [auto1.it] INFO: Scrape type for WX11793: 0
2026-03-28 12:09:04 [auto1.it] INFO: Found listing with ID: ST52943
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST52943%27 HTTP/1.1" 200 None
2026-03-28 12:09:04 [auto1.it] INFO: Scrape type for ST52943: 2
2026-03-28 12:09:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90bb4c22-e114-5685-98cf-78db6186fcc7 with identifier: ST52943
2026-03-28 12:09:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90bb4c22-e114-5685-98cf-78db6186fcc7 with scrape type 2
2026-03-28 12:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90bb4c22-e114-5685-98cf-78db6186fcc7 with scrape type 2
2026-03-28 12:09:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 90bb4c22-e114-5685-98cf-78db6186fcc7, identifier: ST52943
2026-03-28 12:09:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 90bb4c22-e114-5685-98cf-78db6186fcc7 with identifier: ST52943
2026-03-28 12:09:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 90bb4c22-e114-5685-98cf-78db6186fcc7 with identifier: ST52943
2026-03-28 12:09:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 90bb4c22-e114-5685-98cf-78db6186fcc7 with identifier: ST52943 to the API
2026-03-28 12:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:07:51Z',
 'fuel_type': 'diesel',
 'id': '90bb4c22-e114-5685-98cf-78db6186fcc7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST52943',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 156579,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-09',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2011}
2026-03-28 12:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST52943%27 HTTP/1.1" 200 None
2026-03-28 12:09:05 [auto1.it] INFO: Saving data for ST52943: {'auction_closing_time': 1774714071.0, 'created_time': 1772175831.54946, 'last_price_update_time': 1774699745.37027}
2026-03-28 12:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ST52943') HTTP/1.1" 204 0
2026-03-28 12:09:05 [auto1.it] INFO: Found listing with ID: JF99545
2026-03-28 12:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF99545%27 HTTP/1.1" 200 None
2026-03-28 12:09:05 [auto1.it] INFO: Scrape type for JF99545: 0
2026-03-28 12:09:05 [auto1.it] INFO: Found listing with ID: SV47237
2026-03-28 12:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV47237%27 HTTP/1.1" 200 None
2026-03-28 12:09:05 [auto1.it] INFO: Scrape type for SV47237: 0
2026-03-28 12:09:05 [auto1.it] INFO: Found listing with ID: JS59612
2026-03-28 12:09:05 [auto1.it] INFO: Found listing with ID: JC86695
2026-03-28 12:09:05 [auto1.it] INFO: Found listing with ID: HU75847
2026-03-28 12:09:05 [auto1.it] INFO: Found listing with ID: SS52204
2026-03-28 12:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS52204%27 HTTP/1.1" 200 None
2026-03-28 12:09:05 [auto1.it] INFO: Scrape type for SS52204: 0
2026-03-28 12:09:05 [auto1.it] INFO: Found listing with ID: NF28136
2026-03-28 12:09:05 [scrapy.extensions.logstats] INFO: Crawled 246 pages (at 21 pages/min), scraped 181 items (at 44 items/min)
2026-03-28 12:09:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 200MiB
2026-03-28 12:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:09:06 [auto1.it] INFO: Channel: 24h | Page: 51 | totalHits: 3675 | hits on page: 40
2026-03-28 12:09:06 [auto1.it] INFO: Found listing with ID: AX14141
2026-03-28 12:09:06 [auto1.it] INFO: Found listing with ID: AM53032
2026-03-28 12:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AM53032%27 HTTP/1.1" 200 None
2026-03-28 12:09:06 [auto1.it] INFO: Scrape type for AM53032: 0
2026-03-28 12:09:06 [auto1.it] INFO: Found listing with ID: MY48140
2026-03-28 12:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MY48140%27 HTTP/1.1" 200 None
2026-03-28 12:09:06 [auto1.it] INFO: Scrape type for MY48140: 0
2026-03-28 12:09:06 [auto1.it] INFO: Found listing with ID: MK51639
2026-03-28 12:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MK51639%27 HTTP/1.1" 200 None
2026-03-28 12:09:06 [auto1.it] INFO: Scrape type for MK51639: 0
2026-03-28 12:09:06 [auto1.it] INFO: Found listing with ID: TP30919
2026-03-28 12:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP30919%27 HTTP/1.1" 200 None
2026-03-28 12:09:06 [auto1.it] INFO: Scrape type for TP30919: 0
2026-03-28 12:09:06 [auto1.it] INFO: Found listing with ID: AA66716
2026-03-28 12:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AA66716%27 HTTP/1.1" 200 None
2026-03-28 12:09:06 [auto1.it] INFO: Scrape type for AA66716: 0
2026-03-28 12:09:06 [auto1.it] INFO: Found listing with ID: PZ55071
2026-03-28 12:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ55071%27 HTTP/1.1" 200 None
2026-03-28 12:09:06 [auto1.it] INFO: Scrape type for PZ55071: 2
2026-03-28 12:09:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95e81267-fc75-5cd1-874f-cc8260e4b1d9 with identifier: PZ55071
2026-03-28 12:09:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95e81267-fc75-5cd1-874f-cc8260e4b1d9 with scrape type 2
2026-03-28 12:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95e81267-fc75-5cd1-874f-cc8260e4b1d9 with scrape type 2
2026-03-28 12:09:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 95e81267-fc75-5cd1-874f-cc8260e4b1d9, identifier: PZ55071
2026-03-28 12:09:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 95e81267-fc75-5cd1-874f-cc8260e4b1d9 with identifier: PZ55071
2026-03-28 12:09:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 95e81267-fc75-5cd1-874f-cc8260e4b1d9 with identifier: PZ55071
2026-03-28 12:09:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 95e81267-fc75-5cd1-874f-cc8260e4b1d9 with identifier: PZ55071 to the API
2026-03-28 12:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:38:50Z',
 'fuel_type': 'diesel',
 'id': '95e81267-fc75-5cd1-874f-cc8260e4b1d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ55071',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 185109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-22',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 Turbodiesel N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2017}
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ55071%27 HTTP/1.1" 200 None
2026-03-28 12:09:07 [auto1.it] INFO: Saving data for PZ55071: {'auction_closing_time': 1774715930.0, 'created_time': 1774516028.781932, 'last_price_update_time': 1774699747.15537}
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PZ55071') HTTP/1.1" 204 0
2026-03-28 12:09:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:09:07 [auto1.it] INFO: Found listing with ID: HX67406
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HX67406%27 HTTP/1.1" 200 None
2026-03-28 12:09:07 [auto1.it] INFO: Scrape type for HX67406: 0
2026-03-28 12:09:07 [auto1.it] INFO: Found listing with ID: LT18779
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LT18779%27 HTTP/1.1" 200 None
2026-03-28 12:09:07 [auto1.it] INFO: Scrape type for LT18779: 0
2026-03-28 12:09:07 [auto1.it] INFO: Found listing with ID: KZ33139
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ33139%27 HTTP/1.1" 200 None
2026-03-28 12:09:07 [auto1.it] INFO: Scrape type for KZ33139: 0
2026-03-28 12:09:07 [auto1.it] INFO: Found listing with ID: EC20535
2026-03-28 12:09:07 [auto1.it] INFO: Found listing with ID: PG53512
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PG53512%27 HTTP/1.1" 200 None
2026-03-28 12:09:07 [auto1.it] INFO: Scrape type for PG53512: 0
2026-03-28 12:09:07 [auto1.it] INFO: Found listing with ID: ZB38211
2026-03-28 12:09:07 [auto1.it] INFO: Found listing with ID: GX99306
2026-03-28 12:09:07 [auto1.it] INFO: Found listing with ID: DX18897
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX18897%27 HTTP/1.1" 200 None
2026-03-28 12:09:07 [auto1.it] INFO: Scrape type for DX18897: 0
2026-03-28 12:09:07 [auto1.it] INFO: Found listing with ID: DA44533
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA44533%27 HTTP/1.1" 200 None
2026-03-28 12:09:07 [auto1.it] INFO: Scrape type for DA44533: 0
2026-03-28 12:09:07 [auto1.it] INFO: Found listing with ID: YW84907
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW84907%27 HTTP/1.1" 200 None
2026-03-28 12:09:07 [auto1.it] INFO: Scrape type for YW84907: 0
2026-03-28 12:09:07 [auto1.it] INFO: Found listing with ID: TZ66413
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ66413%27 HTTP/1.1" 200 None
2026-03-28 12:09:07 [auto1.it] INFO: Scrape type for TZ66413: 0
2026-03-28 12:09:07 [auto1.it] INFO: Found listing with ID: HE47711
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE47711%27 HTTP/1.1" 200 None
2026-03-28 12:09:07 [auto1.it] INFO: Scrape type for HE47711: 2
2026-03-28 12:09:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 793e644d-c1fe-56e4-ac7d-869318d00601 with identifier: HE47711
2026-03-28 12:09:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 793e644d-c1fe-56e4-ac7d-869318d00601 with scrape type 2
2026-03-28 12:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 793e644d-c1fe-56e4-ac7d-869318d00601 with scrape type 2
2026-03-28 12:09:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 793e644d-c1fe-56e4-ac7d-869318d00601, identifier: HE47711
2026-03-28 12:09:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 793e644d-c1fe-56e4-ac7d-869318d00601 with identifier: HE47711
2026-03-28 12:09:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 793e644d-c1fe-56e4-ac7d-869318d00601 with identifier: HE47711
2026-03-28 12:09:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 793e644d-c1fe-56e4-ac7d-869318d00601 with identifier: HE47711 to the API
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:12:51Z',
 'fuel_type': 'hybrid',
 'id': '793e644d-c1fe-56e4-ac7d-869318d00601',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE47711',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 40187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-27',
 'seller_name': None,
 'title': 'Jeep Compass 1.3 T4 4xe Plug-in Hybrid 80th Anniversary',
 'transmission': 'automatic',
 'trim': '80th Anniversary',
 'year': 2023}
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE47711%27 HTTP/1.1" 200 None
2026-03-28 12:09:07 [auto1.it] INFO: Saving data for HE47711: {'auction_closing_time': 1774714371.0, 'created_time': 1774516037.467847, 'last_price_update_time': 1774699747.834076}
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HE47711') HTTP/1.1" 204 0
2026-03-28 12:09:07 [auto1.it] INFO: Found listing with ID: WD11743
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD11743%27 HTTP/1.1" 200 None
2026-03-28 12:09:07 [auto1.it] INFO: Scrape type for WD11743: 0
2026-03-28 12:09:07 [auto1.it] INFO: Found listing with ID: AE90071
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AE90071%27 HTTP/1.1" 200 None
2026-03-28 12:09:07 [auto1.it] INFO: Scrape type for AE90071: 0
2026-03-28 12:09:07 [auto1.it] INFO: Found listing with ID: YJ19643
2026-03-28 12:09:07 [auto1.it] INFO: Found listing with ID: TH56934
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH56934%27 HTTP/1.1" 200 None
2026-03-28 12:09:07 [auto1.it] INFO: Scrape type for TH56934: 2
2026-03-28 12:09:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 812ad792-072c-5a6c-be1e-d3b799ecb9d0 with identifier: TH56934
2026-03-28 12:09:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 812ad792-072c-5a6c-be1e-d3b799ecb9d0 with scrape type 2
2026-03-28 12:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 812ad792-072c-5a6c-be1e-d3b799ecb9d0 with scrape type 2
2026-03-28 12:09:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 812ad792-072c-5a6c-be1e-d3b799ecb9d0, identifier: TH56934
2026-03-28 12:09:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 812ad792-072c-5a6c-be1e-d3b799ecb9d0 with identifier: TH56934
2026-03-28 12:09:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 812ad792-072c-5a6c-be1e-d3b799ecb9d0 with identifier: TH56934
2026-03-28 12:09:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 812ad792-072c-5a6c-be1e-d3b799ecb9d0 with identifier: TH56934 to the API
2026-03-28 12:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:12:11Z',
 'fuel_type': 'petrol',
 'id': '812ad792-072c-5a6c-be1e-d3b799ecb9d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH56934',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 167793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-17',
 'seller_name': None,
 'title': 'Suzuki Swift 1.6 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2013}
2026-03-28 12:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH56934%27 HTTP/1.1" 200 None
2026-03-28 12:09:08 [auto1.it] INFO: Saving data for TH56934: {'auction_closing_time': 1774714331.0, 'created_time': 1774516057.597462, 'last_price_update_time': 1774699748.411797}
2026-03-28 12:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TH56934') HTTP/1.1" 204 0
2026-03-28 12:09:08 [auto1.it] INFO: Found listing with ID: AH91466
2026-03-28 12:09:08 [auto1.it] INFO: Found listing with ID: NE50995
2026-03-28 12:09:08 [auto1.it] INFO: Found listing with ID: AU71506
2026-03-28 12:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU71506%27 HTTP/1.1" 200 None
2026-03-28 12:09:08 [auto1.it] INFO: Scrape type for AU71506: 0
2026-03-28 12:09:08 [auto1.it] INFO: Found listing with ID: NX21307
2026-03-28 12:09:08 [auto1.it] INFO: Found listing with ID: KW35256
2026-03-28 12:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW35256%27 HTTP/1.1" 200 None
2026-03-28 12:09:08 [auto1.it] INFO: Scrape type for KW35256: 0
2026-03-28 12:09:08 [auto1.it] INFO: Found listing with ID: DL15591
2026-03-28 12:09:08 [auto1.it] INFO: Found listing with ID: SF57726
2026-03-28 12:09:08 [auto1.it] INFO: Found listing with ID: MU47199
2026-03-28 12:09:08 [auto1.it] INFO: Found listing with ID: YZ06179
2026-03-28 12:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YZ06179%27 HTTP/1.1" 200 None
2026-03-28 12:09:08 [auto1.it] INFO: Scrape type for YZ06179: 0
2026-03-28 12:09:08 [auto1.it] INFO: Found listing with ID: TU42208
2026-03-28 12:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU42208%27 HTTP/1.1" 200 None
2026-03-28 12:09:08 [auto1.it] INFO: Scrape type for TU42208: 0
2026-03-28 12:09:08 [auto1.it] INFO: Found listing with ID: KJ92535
2026-03-28 12:09:08 [auto1.it] INFO: Found listing with ID: KV45254
2026-03-28 12:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KV45254%27 HTTP/1.1" 200 None
2026-03-28 12:09:08 [auto1.it] INFO: Scrape type for KV45254: 0
2026-03-28 12:09:08 [auto1.it] INFO: Found listing with ID: FU36287
2026-03-28 12:09:08 [auto1.it] INFO: Found listing with ID: WL38186
2026-03-28 12:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL38186%27 HTTP/1.1" 200 None
2026-03-28 12:09:08 [auto1.it] INFO: Scrape type for WL38186: 0
2026-03-28 12:09:08 [auto1.it] INFO: Found listing with ID: HW99269
2026-03-28 12:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW99269%27 HTTP/1.1" 200 None
2026-03-28 12:09:08 [auto1.it] INFO: Scrape type for HW99269: 2
2026-03-28 12:09:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b923f9b-70b0-56e6-92e2-70cc3ef9c6c1 with identifier: HW99269
2026-03-28 12:09:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b923f9b-70b0-56e6-92e2-70cc3ef9c6c1 with scrape type 2
2026-03-28 12:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b923f9b-70b0-56e6-92e2-70cc3ef9c6c1 with scrape type 2
2026-03-28 12:09:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1b923f9b-70b0-56e6-92e2-70cc3ef9c6c1, identifier: HW99269
2026-03-28 12:09:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1b923f9b-70b0-56e6-92e2-70cc3ef9c6c1 with identifier: HW99269
2026-03-28 12:09:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1b923f9b-70b0-56e6-92e2-70cc3ef9c6c1 with identifier: HW99269
2026-03-28 12:09:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1b923f9b-70b0-56e6-92e2-70cc3ef9c6c1 with identifier: HW99269 to the API
2026-03-28 12:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:02:14Z',
 'fuel_type': 'diesel',
 'id': '1b923f9b-70b0-56e6-92e2-70cc3ef9c6c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW99269',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 416609,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-06-30',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-28 12:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW99269%27 HTTP/1.1" 200 None
2026-03-28 12:09:09 [auto1.it] INFO: Saving data for HW99269: {'auction_closing_time': 1774713734.0, 'created_time': 1774515997.958304, 'last_price_update_time': 1774699749.03984}
2026-03-28 12:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HW99269') HTTP/1.1" 204 0
2026-03-28 12:09:09 [auto1.it] INFO: Found listing with ID: WS00889
2026-03-28 12:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WS00889%27 HTTP/1.1" 200 None
2026-03-28 12:09:09 [auto1.it] INFO: Scrape type for WS00889: 0
2026-03-28 12:09:09 [auto1.it] INFO: Found listing with ID: RK73921
2026-03-28 12:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK73921%27 HTTP/1.1" 200 None
2026-03-28 12:09:09 [auto1.it] INFO: Scrape type for RK73921: 0
2026-03-28 12:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:09:10 [auto1.it] INFO: Channel: 24h | Page: 52 | totalHits: 3675 | hits on page: 40
2026-03-28 12:09:10 [auto1.it] INFO: Found listing with ID: HC70741
2026-03-28 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC70741%27 HTTP/1.1" 200 None
2026-03-28 12:09:10 [auto1.it] INFO: Scrape type for HC70741: 0
2026-03-28 12:09:10 [auto1.it] INFO: Found listing with ID: YY30219
2026-03-28 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY30219%27 HTTP/1.1" 200 None
2026-03-28 12:09:10 [auto1.it] INFO: Scrape type for YY30219: 0
2026-03-28 12:09:10 [auto1.it] INFO: Found listing with ID: TD76554
2026-03-28 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD76554%27 HTTP/1.1" 200 None
2026-03-28 12:09:10 [auto1.it] INFO: Scrape type for TD76554: 0
2026-03-28 12:09:10 [auto1.it] INFO: Found listing with ID: VM87489
2026-03-28 12:09:10 [auto1.it] INFO: Found listing with ID: AC54661
2026-03-28 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AC54661%27 HTTP/1.1" 200 None
2026-03-28 12:09:10 [auto1.it] INFO: Scrape type for AC54661: 0
2026-03-28 12:09:10 [auto1.it] INFO: Found listing with ID: PP18921
2026-03-28 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP18921%27 HTTP/1.1" 200 None
2026-03-28 12:09:10 [auto1.it] INFO: Scrape type for PP18921: 0
2026-03-28 12:09:10 [auto1.it] INFO: Found listing with ID: PV19108
2026-03-28 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV19108%27 HTTP/1.1" 200 None
2026-03-28 12:09:10 [auto1.it] INFO: Scrape type for PV19108: 0
2026-03-28 12:09:10 [auto1.it] INFO: Found listing with ID: FF63562
2026-03-28 12:09:10 [auto1.it] INFO: Found listing with ID: AV53481
2026-03-28 12:09:10 [auto1.it] INFO: Found listing with ID: CB62098
2026-03-28 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB62098%27 HTTP/1.1" 200 None
2026-03-28 12:09:10 [auto1.it] INFO: Scrape type for CB62098: 0
2026-03-28 12:09:10 [auto1.it] INFO: Found listing with ID: KS79524
2026-03-28 12:09:10 [auto1.it] INFO: Found listing with ID: HM03162
2026-03-28 12:09:10 [auto1.it] INFO: Found listing with ID: FT78551
2026-03-28 12:09:10 [auto1.it] INFO: Found listing with ID: SD84714
2026-03-28 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD84714%27 HTTP/1.1" 200 None
2026-03-28 12:09:10 [auto1.it] INFO: Scrape type for SD84714: 0
2026-03-28 12:09:10 [auto1.it] INFO: Found listing with ID: KE13415
2026-03-28 12:09:10 [auto1.it] INFO: Found listing with ID: TZ72536
2026-03-28 12:09:10 [auto1.it] INFO: Found listing with ID: SV52525
2026-03-28 12:09:10 [auto1.it] INFO: Found listing with ID: UH63202
2026-03-28 12:09:10 [auto1.it] INFO: Found listing with ID: YA96146
2026-03-28 12:09:10 [auto1.it] INFO: Found listing with ID: SH06277
2026-03-28 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH06277%27 HTTP/1.1" 200 None
2026-03-28 12:09:10 [auto1.it] INFO: Scrape type for SH06277: 0
2026-03-28 12:09:10 [auto1.it] INFO: Found listing with ID: UR19142
2026-03-28 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR19142%27 HTTP/1.1" 200 None
2026-03-28 12:09:10 [auto1.it] INFO: Scrape type for UR19142: 2
2026-03-28 12:09:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb741692-e75b-55ac-8c37-165ef500d842 with identifier: UR19142
2026-03-28 12:09:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb741692-e75b-55ac-8c37-165ef500d842 with scrape type 2
2026-03-28 12:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb741692-e75b-55ac-8c37-165ef500d842 with scrape type 2
2026-03-28 12:09:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cb741692-e75b-55ac-8c37-165ef500d842, identifier: UR19142
2026-03-28 12:09:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cb741692-e75b-55ac-8c37-165ef500d842 with identifier: UR19142
2026-03-28 12:09:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cb741692-e75b-55ac-8c37-165ef500d842 with identifier: UR19142
2026-03-28 12:09:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cb741692-e75b-55ac-8c37-165ef500d842 with identifier: UR19142 to the API
2026-03-28 12:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:33:06Z',
 'fuel_type': 'petrol',
 'id': 'cb741692-e75b-55ac-8c37-165ef500d842',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR19142',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 165811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-23',
 'seller_name': None,
 'title': 'Fiat 500X 1.6 Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2015}
2026-03-28 12:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR19142%27 HTTP/1.1" 200 None
2026-03-28 12:09:11 [auto1.it] INFO: Saving data for UR19142: {'auction_closing_time': 1774715586.0, 'created_time': 1774515951.58229, 'last_price_update_time': 1774699751.016419}
2026-03-28 12:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UR19142') HTTP/1.1" 204 0
2026-03-28 12:09:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:09:11 [auto1.it] INFO: Found listing with ID: XJ75320
2026-03-28 12:09:11 [auto1.it] INFO: Found listing with ID: WK82863
2026-03-28 12:09:11 [auto1.it] INFO: Found listing with ID: JU95085
2026-03-28 12:09:11 [auto1.it] INFO: Found listing with ID: NJ20872
2026-03-28 12:09:11 [auto1.it] INFO: Found listing with ID: VE89845
2026-03-28 12:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VE89845%27 HTTP/1.1" 200 None
2026-03-28 12:09:11 [auto1.it] INFO: Scrape type for VE89845: 0
2026-03-28 12:09:11 [auto1.it] INFO: Found listing with ID: RJ89863
2026-03-28 12:09:11 [auto1.it] INFO: Found listing with ID: VN35608
2026-03-28 12:09:11 [auto1.it] INFO: Found listing with ID: US42109
2026-03-28 12:09:11 [auto1.it] INFO: Found listing with ID: JL30882
2026-03-28 12:09:11 [auto1.it] INFO: Found listing with ID: AP78180
2026-03-28 12:09:11 [auto1.it] INFO: Found listing with ID: DC69304
2026-03-28 12:09:11 [auto1.it] INFO: Found listing with ID: JE58875
2026-03-28 12:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE58875%27 HTTP/1.1" 200 None
2026-03-28 12:09:11 [auto1.it] INFO: Scrape type for JE58875: 0
2026-03-28 12:09:11 [auto1.it] INFO: Found listing with ID: GC49019
2026-03-28 12:09:11 [auto1.it] INFO: Found listing with ID: ZJ87043
2026-03-28 12:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ87043%27 HTTP/1.1" 200 None
2026-03-28 12:09:11 [auto1.it] INFO: Scrape type for ZJ87043: 0
2026-03-28 12:09:11 [auto1.it] INFO: Found listing with ID: BZ19379
2026-03-28 12:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ19379%27 HTTP/1.1" 200 None
2026-03-28 12:09:11 [auto1.it] INFO: Scrape type for BZ19379: 0
2026-03-28 12:09:11 [auto1.it] INFO: Found listing with ID: MG94028
2026-03-28 12:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG94028%27 HTTP/1.1" 200 None
2026-03-28 12:09:11 [auto1.it] INFO: Scrape type for MG94028: 0
2026-03-28 12:09:11 [auto1.it] INFO: Found listing with ID: NG57771
2026-03-28 12:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG57771%27 HTTP/1.1" 200 None
2026-03-28 12:09:11 [auto1.it] INFO: Scrape type for NG57771: 0
2026-03-28 12:09:11 [auto1.it] INFO: Found listing with ID: LT57228
2026-03-28 12:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LT57228%27 HTTP/1.1" 200 None
2026-03-28 12:09:11 [auto1.it] INFO: Scrape type for LT57228: 0
2026-03-28 12:09:11 [auto1.it] INFO: Found listing with ID: CF86558
2026-03-28 12:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CF86558%27 HTTP/1.1" 200 None
2026-03-28 12:09:11 [auto1.it] INFO: Scrape type for CF86558: 0
2026-03-28 12:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:09:12 [auto1.it] INFO: Channel: 24h | Page: 53 | totalHits: 3675 | hits on page: 40
2026-03-28 12:09:12 [auto1.it] INFO: Found listing with ID: JN49587
2026-03-28 12:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN49587%27 HTTP/1.1" 200 None
2026-03-28 12:09:12 [auto1.it] INFO: Scrape type for JN49587: 0
2026-03-28 12:09:12 [auto1.it] INFO: Found listing with ID: PG13965
2026-03-28 12:09:12 [auto1.it] INFO: Found listing with ID: NL47700
2026-03-28 12:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL47700%27 HTTP/1.1" 200 None
2026-03-28 12:09:12 [auto1.it] INFO: Scrape type for NL47700: 2
2026-03-28 12:09:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e8aaf2a-e70e-572b-87fc-a926666437a3 with identifier: NL47700
2026-03-28 12:09:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e8aaf2a-e70e-572b-87fc-a926666437a3 with scrape type 2
2026-03-28 12:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e8aaf2a-e70e-572b-87fc-a926666437a3 with scrape type 2
2026-03-28 12:09:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8e8aaf2a-e70e-572b-87fc-a926666437a3, identifier: NL47700
2026-03-28 12:09:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8e8aaf2a-e70e-572b-87fc-a926666437a3 with identifier: NL47700
2026-03-28 12:09:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8e8aaf2a-e70e-572b-87fc-a926666437a3 with identifier: NL47700
2026-03-28 12:09:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8e8aaf2a-e70e-572b-87fc-a926666437a3 with identifier: NL47700 to the API
2026-03-28 12:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:45:26Z',
 'fuel_type': 'gas',
 'id': '8e8aaf2a-e70e-572b-87fc-a926666437a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL47700',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Jogger',
 'odometer': 23990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-28',
 'seller_name': None,
 'title': 'Dacia Jogger 1.0 TCe LPG Extreme',
 'transmission': 'manual',
 'trim': 'Extreme',
 'year': 2023}
2026-03-28 12:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL47700%27 HTTP/1.1" 200 None
2026-03-28 12:09:12 [auto1.it] INFO: Saving data for NL47700: {'auction_closing_time': 1774716326.0, 'created_time': 1774515982.4492, 'last_price_update_time': 1774699752.742574}
2026-03-28 12:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NL47700') HTTP/1.1" 204 0
2026-03-28 12:09:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:09:12 [auto1.it] INFO: Found listing with ID: JU28739
2026-03-28 12:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU28739%27 HTTP/1.1" 200 None
2026-03-28 12:09:12 [auto1.it] INFO: Scrape type for JU28739: 0
2026-03-28 12:09:12 [auto1.it] INFO: Found listing with ID: ZC80598
2026-03-28 12:09:12 [auto1.it] INFO: Found listing with ID: YW38439
2026-03-28 12:09:12 [auto1.it] INFO: Found listing with ID: ZT67877
2026-03-28 12:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT67877%27 HTTP/1.1" 200 None
2026-03-28 12:09:12 [auto1.it] INFO: Scrape type for ZT67877: 0
2026-03-28 12:09:12 [auto1.it] INFO: Found listing with ID: HT64034
2026-03-28 12:09:12 [auto1.it] INFO: Found listing with ID: RV54155
2026-03-28 12:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV54155%27 HTTP/1.1" 200 None
2026-03-28 12:09:12 [auto1.it] INFO: Scrape type for RV54155: 0
2026-03-28 12:09:12 [auto1.it] INFO: Found listing with ID: FH96840
2026-03-28 12:09:12 [auto1.it] INFO: Found listing with ID: EF61328
2026-03-28 12:09:12 [auto1.it] INFO: Found listing with ID: JK09197
2026-03-28 12:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK09197%27 HTTP/1.1" 200 None
2026-03-28 12:09:12 [auto1.it] INFO: Scrape type for JK09197: 2
2026-03-28 12:09:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 058fda09-6135-579f-8037-14f558f2c064 with identifier: JK09197
2026-03-28 12:09:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 058fda09-6135-579f-8037-14f558f2c064 with scrape type 2
2026-03-28 12:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 058fda09-6135-579f-8037-14f558f2c064 with scrape type 2
2026-03-28 12:09:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 058fda09-6135-579f-8037-14f558f2c064, identifier: JK09197
2026-03-28 12:09:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 058fda09-6135-579f-8037-14f558f2c064 with identifier: JK09197
2026-03-28 12:09:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 058fda09-6135-579f-8037-14f558f2c064 with identifier: JK09197
2026-03-28 12:09:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 058fda09-6135-579f-8037-14f558f2c064 with identifier: JK09197 to the API
2026-03-28 12:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:09:36Z',
 'fuel_type': 'diesel',
 'id': '058fda09-6135-579f-8037-14f558f2c064',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK09197',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 147460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-21',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Sd4 HSE Dynamic',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic',
 'year': 2015}
2026-03-28 12:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK09197%27 HTTP/1.1" 200 None
2026-03-28 12:09:13 [auto1.it] INFO: Saving data for JK09197: {'auction_closing_time': 1774714176.0, 'created_time': 1774515960.219614, 'last_price_update_time': 1774699753.318546}
2026-03-28 12:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JK09197') HTTP/1.1" 204 0
2026-03-28 12:09:13 [auto1.it] INFO: Found listing with ID: YE07599
2026-03-28 12:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YE07599%27 HTTP/1.1" 200 None
2026-03-28 12:09:13 [auto1.it] INFO: Scrape type for YE07599: 0
2026-03-28 12:09:13 [auto1.it] INFO: Found listing with ID: WH56731
2026-03-28 12:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH56731%27 HTTP/1.1" 200 None
2026-03-28 12:09:13 [auto1.it] INFO: Scrape type for WH56731: 0
2026-03-28 12:09:13 [auto1.it] INFO: Found listing with ID: ST27095
2026-03-28 12:09:13 [auto1.it] INFO: Found listing with ID: LA78712
2026-03-28 12:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA78712%27 HTTP/1.1" 200 None
2026-03-28 12:09:13 [auto1.it] INFO: Scrape type for LA78712: 0
2026-03-28 12:09:13 [auto1.it] INFO: Found listing with ID: FA49150
2026-03-28 12:09:13 [auto1.it] INFO: Found listing with ID: BG04687
2026-03-28 12:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG04687%27 HTTP/1.1" 200 None
2026-03-28 12:09:13 [auto1.it] INFO: Scrape type for BG04687: 0
2026-03-28 12:09:13 [auto1.it] INFO: Found listing with ID: TJ80617
2026-03-28 12:09:13 [auto1.it] INFO: Found listing with ID: MG40784
2026-03-28 12:09:13 [auto1.it] INFO: Found listing with ID: SN49105
2026-03-28 12:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN49105%27 HTTP/1.1" 200 None
2026-03-28 12:09:13 [auto1.it] INFO: Scrape type for SN49105: 0
2026-03-28 12:09:13 [auto1.it] INFO: Found listing with ID: SK14741
2026-03-28 12:09:13 [auto1.it] INFO: Found listing with ID: VB21565
2026-03-28 12:09:13 [auto1.it] INFO: Found listing with ID: LC83851
2026-03-28 12:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC83851%27 HTTP/1.1" 200 None
2026-03-28 12:09:13 [auto1.it] INFO: Scrape type for LC83851: 0
2026-03-28 12:09:13 [auto1.it] INFO: Found listing with ID: HL58093
2026-03-28 12:09:13 [auto1.it] INFO: Found listing with ID: KC12001
2026-03-28 12:09:13 [auto1.it] INFO: Found listing with ID: BF03826
2026-03-28 12:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF03826%27 HTTP/1.1" 200 None
2026-03-28 12:09:13 [auto1.it] INFO: Scrape type for BF03826: 0
2026-03-28 12:09:13 [auto1.it] INFO: Found listing with ID: CT12062
2026-03-28 12:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT12062%27 HTTP/1.1" 200 None
2026-03-28 12:09:13 [auto1.it] INFO: Scrape type for CT12062: 0
2026-03-28 12:09:13 [auto1.it] INFO: Found listing with ID: WH54468
2026-03-28 12:09:13 [auto1.it] INFO: Found listing with ID: LK23524
2026-03-28 12:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LK23524%27 HTTP/1.1" 200 None
2026-03-28 12:09:13 [auto1.it] INFO: Scrape type for LK23524: 2
2026-03-28 12:09:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8dd9f9b0-1822-5b19-ad19-8d0f540de83d with identifier: LK23524
2026-03-28 12:09:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dd9f9b0-1822-5b19-ad19-8d0f540de83d with scrape type 2
2026-03-28 12:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8dd9f9b0-1822-5b19-ad19-8d0f540de83d with scrape type 2
2026-03-28 12:09:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8dd9f9b0-1822-5b19-ad19-8d0f540de83d, identifier: LK23524
2026-03-28 12:09:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8dd9f9b0-1822-5b19-ad19-8d0f540de83d with identifier: LK23524
2026-03-28 12:09:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8dd9f9b0-1822-5b19-ad19-8d0f540de83d with identifier: LK23524
2026-03-28 12:09:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8dd9f9b0-1822-5b19-ad19-8d0f540de83d with identifier: LK23524 to the API
2026-03-28 12:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:21:09Z',
 'fuel_type': 'petrol',
 'id': '8dd9f9b0-1822-5b19-ad19-8d0f540de83d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK23524',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'forfour',
 'odometer': 127694,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-26',
 'seller_name': None,
 'title': 'Smart forfour 1.0 Basis passion',
 'transmission': 'manual',
 'trim': 'Basis passion',
 'year': 2015}
2026-03-28 12:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LK23524%27 HTTP/1.1" 200 None
2026-03-28 12:09:13 [auto1.it] INFO: Saving data for LK23524: {'auction_closing_time': 1774714869.0, 'created_time': 1774516056.602696, 'last_price_update_time': 1774699753.860591}
2026-03-28 12:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LK23524') HTTP/1.1" 204 0
2026-03-28 12:09:13 [auto1.it] INFO: Found listing with ID: WS49358
2026-03-28 12:09:13 [auto1.it] INFO: Found listing with ID: ED17590
2026-03-28 12:09:13 [auto1.it] INFO: Found listing with ID: FB83790
2026-03-28 12:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB83790%27 HTTP/1.1" 200 None
2026-03-28 12:09:13 [auto1.it] INFO: Scrape type for FB83790: 0
2026-03-28 12:09:13 [auto1.it] INFO: Found listing with ID: FP39081
2026-03-28 12:09:13 [auto1.it] INFO: Found listing with ID: KC49805
2026-03-28 12:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC49805%27 HTTP/1.1" 200 None
2026-03-28 12:09:14 [auto1.it] INFO: Scrape type for KC49805: 0
2026-03-28 12:09:14 [auto1.it] INFO: Found listing with ID: DU03202
2026-03-28 12:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU03202%27 HTTP/1.1" 200 None
2026-03-28 12:09:14 [auto1.it] INFO: Scrape type for DU03202: 0
2026-03-28 12:09:14 [auto1.it] INFO: Found listing with ID: HK89247
2026-03-28 12:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK89247%27 HTTP/1.1" 200 None
2026-03-28 12:09:14 [auto1.it] INFO: Scrape type for HK89247: 0
2026-03-28 12:09:14 [auto1.it] INFO: Found listing with ID: CW79165
2026-03-28 12:09:14 [auto1.it] INFO: Found listing with ID: JE99705
2026-03-28 12:09:14 [auto1.it] INFO: Found listing with ID: LU55329
2026-03-28 12:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:09:16 [auto1.it] INFO: Channel: 24h | Page: 54 | totalHits: 3675 | hits on page: 40
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: YD85432
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: GJ95983
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: SP63067
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: KJ50164
2026-03-28 12:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KJ50164%27 HTTP/1.1" 200 None
2026-03-28 12:09:16 [auto1.it] INFO: Scrape type for KJ50164: 0
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: VU48365
2026-03-28 12:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU48365%27 HTTP/1.1" 200 None
2026-03-28 12:09:16 [auto1.it] INFO: Scrape type for VU48365: 0
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: RS99601
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: HS43445
2026-03-28 12:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS43445%27 HTTP/1.1" 200 None
2026-03-28 12:09:16 [auto1.it] INFO: Scrape type for HS43445: 0
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: KL91026
2026-03-28 12:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL91026%27 HTTP/1.1" 200 None
2026-03-28 12:09:16 [auto1.it] INFO: Scrape type for KL91026: 0
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: KP30696
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: LL54959
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: MX03417
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: HY79670
2026-03-28 12:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY79670%27 HTTP/1.1" 200 None
2026-03-28 12:09:16 [auto1.it] INFO: Scrape type for HY79670: 0
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: BC39052
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: TR00137
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: WU76177
2026-03-28 12:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU76177%27 HTTP/1.1" 200 None
2026-03-28 12:09:16 [auto1.it] INFO: Scrape type for WU76177: 0
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: DF56056
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: YV46524
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: GJ72408
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: ZR61375
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: GT16147
2026-03-28 12:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT16147%27 HTTP/1.1" 200 None
2026-03-28 12:09:16 [auto1.it] INFO: Scrape type for GT16147: 0
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: ZB49687
2026-03-28 12:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZB49687%27 HTTP/1.1" 200 None
2026-03-28 12:09:16 [auto1.it] INFO: Scrape type for ZB49687: 0
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: EL74502
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: HH94865
2026-03-28 12:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH94865%27 HTTP/1.1" 200 None
2026-03-28 12:09:16 [auto1.it] INFO: Scrape type for HH94865: 0
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: PT71441
2026-03-28 12:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT71441%27 HTTP/1.1" 200 None
2026-03-28 12:09:16 [auto1.it] INFO: Scrape type for PT71441: 0
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: TT80777
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: XX06910
2026-03-28 12:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX06910%27 HTTP/1.1" 200 None
2026-03-28 12:09:16 [auto1.it] INFO: Scrape type for XX06910: 0
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: ZN78264
2026-03-28 12:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN78264%27 HTTP/1.1" 200 None
2026-03-28 12:09:16 [auto1.it] INFO: Scrape type for ZN78264: 0
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: HS52325
2026-03-28 12:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS52325%27 HTTP/1.1" 200 None
2026-03-28 12:09:16 [auto1.it] INFO: Scrape type for HS52325: 0
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: HL91811
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: FS39333
2026-03-28 12:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FS39333%27 HTTP/1.1" 200 None
2026-03-28 12:09:16 [auto1.it] INFO: Scrape type for FS39333: 0
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: NT76067
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: EN82101
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: TU90316
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: CF98226
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: PZ28359
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: TY75037
2026-03-28 12:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY75037%27 HTTP/1.1" 200 None
2026-03-28 12:09:16 [auto1.it] INFO: Scrape type for TY75037: 0
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: HY43750
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: JV69341
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: HZ77474
2026-03-28 12:09:16 [auto1.it] INFO: Found listing with ID: TN35413
2026-03-28 12:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TN35413%27 HTTP/1.1" 200 None
2026-03-28 12:09:16 [auto1.it] INFO: Scrape type for TN35413: 0
2026-03-28 12:09:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:09:18 [auto1.it] INFO: Channel: 24h | Page: 55 | totalHits: 3675 | hits on page: 40
2026-03-28 12:09:18 [auto1.it] INFO: Found listing with ID: KD77242
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD77242%27 HTTP/1.1" 200 None
2026-03-28 12:09:18 [auto1.it] INFO: Scrape type for KD77242: 0
2026-03-28 12:09:18 [auto1.it] INFO: Found listing with ID: UD21419
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD21419%27 HTTP/1.1" 200 None
2026-03-28 12:09:18 [auto1.it] INFO: Scrape type for UD21419: 0
2026-03-28 12:09:18 [auto1.it] INFO: Found listing with ID: MD54154
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD54154%27 HTTP/1.1" 200 None
2026-03-28 12:09:18 [auto1.it] INFO: Scrape type for MD54154: 0
2026-03-28 12:09:18 [auto1.it] INFO: Found listing with ID: DS64702
2026-03-28 12:09:18 [auto1.it] INFO: Found listing with ID: RU70753
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU70753%27 HTTP/1.1" 200 None
2026-03-28 12:09:18 [auto1.it] INFO: Scrape type for RU70753: 0
2026-03-28 12:09:18 [auto1.it] INFO: Found listing with ID: FB74710
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB74710%27 HTTP/1.1" 200 None
2026-03-28 12:09:18 [auto1.it] INFO: Scrape type for FB74710: 0
2026-03-28 12:09:18 [auto1.it] INFO: Found listing with ID: FB96198
2026-03-28 12:09:18 [auto1.it] INFO: Found listing with ID: NN66692
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NN66692%27 HTTP/1.1" 200 None
2026-03-28 12:09:18 [auto1.it] INFO: Scrape type for NN66692: 0
2026-03-28 12:09:18 [auto1.it] INFO: Found listing with ID: YS70370
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS70370%27 HTTP/1.1" 200 None
2026-03-28 12:09:18 [auto1.it] INFO: Scrape type for YS70370: 0
2026-03-28 12:09:18 [auto1.it] INFO: Found listing with ID: YJ87795
2026-03-28 12:09:18 [auto1.it] INFO: Found listing with ID: MR40406
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR40406%27 HTTP/1.1" 200 None
2026-03-28 12:09:18 [auto1.it] INFO: Scrape type for MR40406: 0
2026-03-28 12:09:18 [auto1.it] INFO: Found listing with ID: WA35829
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA35829%27 HTTP/1.1" 200 None
2026-03-28 12:09:18 [auto1.it] INFO: Scrape type for WA35829: 0
2026-03-28 12:09:18 [auto1.it] INFO: Found listing with ID: HF95426
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF95426%27 HTTP/1.1" 200 None
2026-03-28 12:09:18 [auto1.it] INFO: Scrape type for HF95426: 0
2026-03-28 12:09:18 [auto1.it] INFO: Found listing with ID: FB12726
2026-03-28 12:09:18 [auto1.it] INFO: Found listing with ID: YT69462
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT69462%27 HTTP/1.1" 200 None
2026-03-28 12:09:18 [auto1.it] INFO: Scrape type for YT69462: 0
2026-03-28 12:09:18 [auto1.it] INFO: Found listing with ID: UU91583
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU91583%27 HTTP/1.1" 200 None
2026-03-28 12:09:18 [auto1.it] INFO: Scrape type for UU91583: 0
2026-03-28 12:09:18 [auto1.it] INFO: Found listing with ID: XU63603
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU63603%27 HTTP/1.1" 200 None
2026-03-28 12:09:18 [auto1.it] INFO: Scrape type for XU63603: 0
2026-03-28 12:09:18 [auto1.it] INFO: Found listing with ID: EK49781
2026-03-28 12:09:18 [auto1.it] INFO: Found listing with ID: MT13401
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT13401%27 HTTP/1.1" 200 None
2026-03-28 12:09:18 [auto1.it] INFO: Scrape type for MT13401: 0
2026-03-28 12:09:18 [auto1.it] INFO: Found listing with ID: YT05499
2026-03-28 12:09:18 [auto1.it] INFO: Found listing with ID: ZR58855
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR58855%27 HTTP/1.1" 200 None
2026-03-28 12:09:18 [auto1.it] INFO: Scrape type for ZR58855: 0
2026-03-28 12:09:18 [auto1.it] INFO: Found listing with ID: VV47439
2026-03-28 12:09:18 [auto1.it] INFO: Found listing with ID: NF80846
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF80846%27 HTTP/1.1" 200 None
2026-03-28 12:09:18 [auto1.it] INFO: Scrape type for NF80846: 0
2026-03-28 12:09:18 [auto1.it] INFO: Found listing with ID: SJ84275
2026-03-28 12:09:18 [auto1.it] INFO: Found listing with ID: HY53959
2026-03-28 12:09:18 [auto1.it] INFO: Found listing with ID: WB22440
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB22440%27 HTTP/1.1" 200 None
2026-03-28 12:09:18 [auto1.it] INFO: Scrape type for WB22440: 0
2026-03-28 12:09:18 [auto1.it] INFO: Found listing with ID: ME40395
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME40395%27 HTTP/1.1" 200 None
2026-03-28 12:09:18 [auto1.it] INFO: Scrape type for ME40395: 2
2026-03-28 12:09:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0964052e-1c28-56b0-b1e1-e08c79fff4c3 with identifier: ME40395
2026-03-28 12:09:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0964052e-1c28-56b0-b1e1-e08c79fff4c3 with scrape type 2
2026-03-28 12:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0964052e-1c28-56b0-b1e1-e08c79fff4c3 with scrape type 2
2026-03-28 12:09:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0964052e-1c28-56b0-b1e1-e08c79fff4c3, identifier: ME40395
2026-03-28 12:09:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0964052e-1c28-56b0-b1e1-e08c79fff4c3 with identifier: ME40395
2026-03-28 12:09:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0964052e-1c28-56b0-b1e1-e08c79fff4c3 with identifier: ME40395
2026-03-28 12:09:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0964052e-1c28-56b0-b1e1-e08c79fff4c3 with identifier: ME40395 to the API
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:22:35Z',
 'fuel_type': 'petrol',
 'id': '0964052e-1c28-56b0-b1e1-e08c79fff4c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME40395',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'iQ',
 'odometer': 40375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-23',
 'seller_name': None,
 'title': 'Toyota iQ 1.0 VVT-i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME40395%27 HTTP/1.1" 200 None
2026-03-28 12:09:18 [auto1.it] INFO: Saving data for ME40395: {'auction_closing_time': 1774714955.0, 'created_time': 1774429582.142949, 'last_price_update_time': 1774699758.982861}
2026-03-28 12:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ME40395') HTTP/1.1" 204 0
2026-03-28 12:09:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:09:19 [auto1.it] INFO: Found listing with ID: ZU26854
2026-03-28 12:09:19 [auto1.it] INFO: Found listing with ID: JJ73686
2026-03-28 12:09:19 [auto1.it] INFO: Found listing with ID: ZZ72466
2026-03-28 12:09:19 [auto1.it] INFO: Found listing with ID: PZ93737
2026-03-28 12:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ93737%27 HTTP/1.1" 200 None
2026-03-28 12:09:19 [auto1.it] INFO: Scrape type for PZ93737: 0
2026-03-28 12:09:19 [auto1.it] INFO: Found listing with ID: EU94181
2026-03-28 12:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU94181%27 HTTP/1.1" 200 None
2026-03-28 12:09:19 [auto1.it] INFO: Scrape type for EU94181: 0
2026-03-28 12:09:19 [auto1.it] INFO: Found listing with ID: MP71804
2026-03-28 12:09:19 [auto1.it] INFO: Found listing with ID: VM11321
2026-03-28 12:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM11321%27 HTTP/1.1" 200 None
2026-03-28 12:09:19 [auto1.it] INFO: Scrape type for VM11321: 0
2026-03-28 12:09:19 [auto1.it] INFO: Found listing with ID: SC36800
2026-03-28 12:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC36800%27 HTTP/1.1" 200 None
2026-03-28 12:09:19 [auto1.it] INFO: Scrape type for SC36800: 0
2026-03-28 12:09:19 [auto1.it] INFO: Found listing with ID: JR97776
2026-03-28 12:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR97776%27 HTTP/1.1" 200 None
2026-03-28 12:09:19 [auto1.it] INFO: Scrape type for JR97776: 2
2026-03-28 12:09:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c7aac61-e0b4-5314-8d69-cc0ef92fd99e with identifier: JR97776
2026-03-28 12:09:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c7aac61-e0b4-5314-8d69-cc0ef92fd99e with scrape type 2
2026-03-28 12:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c7aac61-e0b4-5314-8d69-cc0ef92fd99e with scrape type 2
2026-03-28 12:09:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7c7aac61-e0b4-5314-8d69-cc0ef92fd99e, identifier: JR97776
2026-03-28 12:09:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7c7aac61-e0b4-5314-8d69-cc0ef92fd99e with identifier: JR97776
2026-03-28 12:09:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7c7aac61-e0b4-5314-8d69-cc0ef92fd99e with identifier: JR97776
2026-03-28 12:09:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7c7aac61-e0b4-5314-8d69-cc0ef92fd99e with identifier: JR97776 to the API
2026-03-28 12:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:21:37Z',
 'fuel_type': 'diesel',
 'id': '7c7aac61-e0b4-5314-8d69-cc0ef92fd99e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR97776',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 182499,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-11',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-28 12:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR97776%27 HTTP/1.1" 200 None
2026-03-28 12:09:19 [auto1.it] INFO: Saving data for JR97776: {'auction_closing_time': 1774714897.0, 'created_time': 1774516016.934437, 'last_price_update_time': 1774699759.619291}
2026-03-28 12:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JR97776') HTTP/1.1" 204 0
2026-03-28 12:09:19 [auto1.it] INFO: Found listing with ID: TD68261
2026-03-28 12:09:19 [auto1.it] INFO: Found listing with ID: BX49691
2026-03-28 12:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX49691%27 HTTP/1.1" 200 None
2026-03-28 12:09:19 [auto1.it] INFO: Scrape type for BX49691: 0
2026-03-28 12:09:19 [auto1.it] INFO: Found listing with ID: RZ83260
2026-03-28 12:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ83260%27 HTTP/1.1" 200 None
2026-03-28 12:09:19 [auto1.it] INFO: Scrape type for RZ83260: 0
2026-03-28 12:09:19 [auto1.it] INFO: Found listing with ID: XW05686
2026-03-28 12:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW05686%27 HTTP/1.1" 200 None
2026-03-28 12:09:19 [auto1.it] INFO: Scrape type for XW05686: 0
2026-03-28 12:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:09:20 [auto1.it] INFO: Channel: 24h | Page: 56 | totalHits: 3675 | hits on page: 40
2026-03-28 12:09:20 [auto1.it] INFO: Found listing with ID: XW18282
2026-03-28 12:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW18282%27 HTTP/1.1" 200 None
2026-03-28 12:09:20 [auto1.it] INFO: Scrape type for XW18282: 0
2026-03-28 12:09:20 [auto1.it] INFO: Found listing with ID: TZ10866
2026-03-28 12:09:20 [auto1.it] INFO: Found listing with ID: KZ85828
2026-03-28 12:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ85828%27 HTTP/1.1" 200 None
2026-03-28 12:09:20 [auto1.it] INFO: Scrape type for KZ85828: 0
2026-03-28 12:09:20 [auto1.it] INFO: Found listing with ID: BN48518
2026-03-28 12:09:20 [auto1.it] INFO: Found listing with ID: UV86108
2026-03-28 12:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UV86108%27 HTTP/1.1" 200 None
2026-03-28 12:09:20 [auto1.it] INFO: Scrape type for UV86108: 0
2026-03-28 12:09:20 [auto1.it] INFO: Found listing with ID: RM97748
2026-03-28 12:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM97748%27 HTTP/1.1" 200 None
2026-03-28 12:09:20 [auto1.it] INFO: Scrape type for RM97748: 0
2026-03-28 12:09:20 [auto1.it] INFO: Found listing with ID: BG14963
2026-03-28 12:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG14963%27 HTTP/1.1" 200 None
2026-03-28 12:09:20 [auto1.it] INFO: Scrape type for BG14963: 0
2026-03-28 12:09:20 [auto1.it] INFO: Found listing with ID: KF47739
2026-03-28 12:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF47739%27 HTTP/1.1" 200 None
2026-03-28 12:09:20 [auto1.it] INFO: Scrape type for KF47739: 0
2026-03-28 12:09:20 [auto1.it] INFO: Found listing with ID: KD47428
2026-03-28 12:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD47428%27 HTTP/1.1" 200 None
2026-03-28 12:09:20 [auto1.it] INFO: Scrape type for KD47428: 0
2026-03-28 12:09:20 [auto1.it] INFO: Found listing with ID: MN95731
2026-03-28 12:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN95731%27 HTTP/1.1" 200 None
2026-03-28 12:09:20 [auto1.it] INFO: Scrape type for MN95731: 0
2026-03-28 12:09:20 [auto1.it] INFO: Found listing with ID: BV54558
2026-03-28 12:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV54558%27 HTTP/1.1" 200 None
2026-03-28 12:09:20 [auto1.it] INFO: Scrape type for BV54558: 0
2026-03-28 12:09:20 [auto1.it] INFO: Found listing with ID: ZD60941
2026-03-28 12:09:20 [auto1.it] INFO: Found listing with ID: ZF37954
2026-03-28 12:09:20 [auto1.it] INFO: Found listing with ID: BL12911
2026-03-28 12:09:20 [auto1.it] INFO: Found listing with ID: NE73775
2026-03-28 12:09:20 [auto1.it] INFO: Found listing with ID: BJ73113
2026-03-28 12:09:20 [auto1.it] INFO: Found listing with ID: UG81579
2026-03-28 12:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UG81579%27 HTTP/1.1" 200 None
2026-03-28 12:09:20 [auto1.it] INFO: Scrape type for UG81579: 0
2026-03-28 12:09:20 [auto1.it] INFO: Found listing with ID: ZD82029
2026-03-28 12:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD82029%27 HTTP/1.1" 200 None
2026-03-28 12:09:20 [auto1.it] INFO: Scrape type for ZD82029: 0
2026-03-28 12:09:20 [auto1.it] INFO: Found listing with ID: NE01926
2026-03-28 12:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE01926%27 HTTP/1.1" 200 None
2026-03-28 12:09:20 [auto1.it] INFO: Scrape type for NE01926: 0
2026-03-28 12:09:20 [auto1.it] INFO: Found listing with ID: PM63773
2026-03-28 12:09:20 [auto1.it] INFO: Found listing with ID: YS46999
2026-03-28 12:09:20 [auto1.it] INFO: Found listing with ID: NH03785
2026-03-28 12:09:20 [auto1.it] INFO: Found listing with ID: DF59331
2026-03-28 12:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF59331%27 HTTP/1.1" 200 None
2026-03-28 12:09:21 [auto1.it] INFO: Scrape type for DF59331: 0
2026-03-28 12:09:21 [auto1.it] INFO: Found listing with ID: PB31965
2026-03-28 12:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PB31965%27 HTTP/1.1" 200 None
2026-03-28 12:09:21 [auto1.it] INFO: Scrape type for PB31965: 0
2026-03-28 12:09:21 [auto1.it] INFO: Found listing with ID: BU54586
2026-03-28 12:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BU54586%27 HTTP/1.1" 200 None
2026-03-28 12:09:21 [auto1.it] INFO: Scrape type for BU54586: 0
2026-03-28 12:09:21 [auto1.it] INFO: Found listing with ID: YA22905
2026-03-28 12:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA22905%27 HTTP/1.1" 200 None
2026-03-28 12:09:21 [auto1.it] INFO: Scrape type for YA22905: 0
2026-03-28 12:09:21 [auto1.it] INFO: Found listing with ID: LT75746
2026-03-28 12:09:21 [auto1.it] INFO: Found listing with ID: XC67854
2026-03-28 12:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC67854%27 HTTP/1.1" 200 None
2026-03-28 12:09:21 [auto1.it] INFO: Scrape type for XC67854: 0
2026-03-28 12:09:21 [auto1.it] INFO: Found listing with ID: HT94696
2026-03-28 12:09:21 [auto1.it] INFO: Found listing with ID: LV20949
2026-03-28 12:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV20949%27 HTTP/1.1" 200 None
2026-03-28 12:09:21 [auto1.it] INFO: Scrape type for LV20949: 0
2026-03-28 12:09:21 [auto1.it] INFO: Found listing with ID: JM05776
2026-03-28 12:09:21 [auto1.it] INFO: Found listing with ID: RB00475
2026-03-28 12:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB00475%27 HTTP/1.1" 200 None
2026-03-28 12:09:21 [auto1.it] INFO: Scrape type for RB00475: 0
2026-03-28 12:09:21 [auto1.it] INFO: Found listing with ID: BL94999
2026-03-28 12:09:21 [auto1.it] INFO: Found listing with ID: NL09316
2026-03-28 12:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL09316%27 HTTP/1.1" 200 None
2026-03-28 12:09:21 [auto1.it] INFO: Scrape type for NL09316: 0
2026-03-28 12:09:21 [auto1.it] INFO: Found listing with ID: TK94629
2026-03-28 12:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK94629%27 HTTP/1.1" 200 None
2026-03-28 12:09:21 [auto1.it] INFO: Scrape type for TK94629: 0
2026-03-28 12:09:21 [auto1.it] INFO: Found listing with ID: TD66065
2026-03-28 12:09:21 [auto1.it] INFO: Found listing with ID: KZ84746
2026-03-28 12:09:21 [auto1.it] INFO: Found listing with ID: KU78765
2026-03-28 12:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KU78765%27 HTTP/1.1" 200 None
2026-03-28 12:09:21 [auto1.it] INFO: Scrape type for KU78765: 0
2026-03-28 12:09:21 [auto1.it] INFO: Found listing with ID: SC05628
2026-03-28 12:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC05628%27 HTTP/1.1" 200 None
2026-03-28 12:09:21 [auto1.it] INFO: Scrape type for SC05628: 0
2026-03-28 12:09:21 [auto1.it] INFO: Found listing with ID: AS40947
2026-03-28 12:09:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:09:22 [auto1.it] INFO: Channel: 24h | Page: 57 | totalHits: 3675 | hits on page: 40
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: JK70304
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: ZJ10623
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: AY88271
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: FA14531
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: VX65874
2026-03-28 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX65874%27 HTTP/1.1" 200 None
2026-03-28 12:09:22 [auto1.it] INFO: Scrape type for VX65874: 0
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: LY05485
2026-03-28 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY05485%27 HTTP/1.1" 200 None
2026-03-28 12:09:22 [auto1.it] INFO: Scrape type for LY05485: 0
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: UT39332
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: RN93859
2026-03-28 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN93859%27 HTTP/1.1" 200 None
2026-03-28 12:09:22 [auto1.it] INFO: Scrape type for RN93859: 0
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: YB60466
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: YV65594
2026-03-28 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV65594%27 HTTP/1.1" 200 None
2026-03-28 12:09:22 [auto1.it] INFO: Scrape type for YV65594: 0
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: MB50671
2026-03-28 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB50671%27 HTTP/1.1" 200 None
2026-03-28 12:09:22 [auto1.it] INFO: Scrape type for MB50671: 0
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: HB16965
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: LN12916
2026-03-28 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN12916%27 HTTP/1.1" 200 None
2026-03-28 12:09:22 [auto1.it] INFO: Scrape type for LN12916: 0
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: CT16450
2026-03-28 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT16450%27 HTTP/1.1" 200 None
2026-03-28 12:09:22 [auto1.it] INFO: Scrape type for CT16450: 0
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: NT40514
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: XL03216
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: YM68683
2026-03-28 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM68683%27 HTTP/1.1" 200 None
2026-03-28 12:09:22 [auto1.it] INFO: Scrape type for YM68683: 0
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: RS48404
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: FN49181
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: LA93311
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: CL54955
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: KY00124
2026-03-28 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KY00124%27 HTTP/1.1" 200 None
2026-03-28 12:09:22 [auto1.it] INFO: Scrape type for KY00124: 0
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: MW20525
2026-03-28 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW20525%27 HTTP/1.1" 200 None
2026-03-28 12:09:22 [auto1.it] INFO: Scrape type for MW20525: 0
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: FM16184
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: BY67467
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: ST73163
2026-03-28 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST73163%27 HTTP/1.1" 200 None
2026-03-28 12:09:22 [auto1.it] INFO: Scrape type for ST73163: 0
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: DV99228
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: UZ46554
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: KM32276
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: KF21230
2026-03-28 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF21230%27 HTTP/1.1" 200 None
2026-03-28 12:09:22 [auto1.it] INFO: Scrape type for KF21230: 0
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: KJ44926
2026-03-28 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KJ44926%27 HTTP/1.1" 200 None
2026-03-28 12:09:22 [auto1.it] INFO: Scrape type for KJ44926: 0
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: KE56728
2026-03-28 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE56728%27 HTTP/1.1" 200 None
2026-03-28 12:09:22 [auto1.it] INFO: Scrape type for KE56728: 0
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: JN46164
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: NG42330
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: DJ11873
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: UH02752
2026-03-28 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH02752%27 HTTP/1.1" 200 None
2026-03-28 12:09:22 [auto1.it] INFO: Scrape type for UH02752: 0
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: TA27022
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: EE25529
2026-03-28 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE25529%27 HTTP/1.1" 200 None
2026-03-28 12:09:22 [auto1.it] INFO: Scrape type for EE25529: 0
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: AK59444
2026-03-28 12:09:22 [auto1.it] INFO: Found listing with ID: MR66716
2026-03-28 12:09:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:09:23 [auto1.it] INFO: Channel: 24h | Page: 58 | totalHits: 3675 | hits on page: 40
2026-03-28 12:09:23 [auto1.it] INFO: Found listing with ID: PA42280
2026-03-28 12:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA42280%27 HTTP/1.1" 200 None
2026-03-28 12:09:23 [auto1.it] INFO: Scrape type for PA42280: 0
2026-03-28 12:09:23 [auto1.it] INFO: Found listing with ID: GW20648
2026-03-28 12:09:23 [auto1.it] INFO: Found listing with ID: JR22558
2026-03-28 12:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR22558%27 HTTP/1.1" 200 None
2026-03-28 12:09:23 [auto1.it] INFO: Scrape type for JR22558: 0
2026-03-28 12:09:23 [auto1.it] INFO: Found listing with ID: NZ11107
2026-03-28 12:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ11107%27 HTTP/1.1" 200 None
2026-03-28 12:09:23 [auto1.it] INFO: Scrape type for NZ11107: 0
2026-03-28 12:09:23 [auto1.it] INFO: Found listing with ID: WN42286
2026-03-28 12:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN42286%27 HTTP/1.1" 200 None
2026-03-28 12:09:23 [auto1.it] INFO: Scrape type for WN42286: 2
2026-03-28 12:09:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cd63502-c6d2-5ee0-859b-4632ebb4ef1e with identifier: WN42286
2026-03-28 12:09:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cd63502-c6d2-5ee0-859b-4632ebb4ef1e with scrape type 2
2026-03-28 12:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cd63502-c6d2-5ee0-859b-4632ebb4ef1e with scrape type 2
2026-03-28 12:09:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0cd63502-c6d2-5ee0-859b-4632ebb4ef1e, identifier: WN42286
2026-03-28 12:09:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0cd63502-c6d2-5ee0-859b-4632ebb4ef1e with identifier: WN42286
2026-03-28 12:09:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0cd63502-c6d2-5ee0-859b-4632ebb4ef1e with identifier: WN42286
2026-03-28 12:09:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0cd63502-c6d2-5ee0-859b-4632ebb4ef1e with identifier: WN42286 to the API
2026-03-28 12:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:18:58Z',
 'fuel_type': 'petrol',
 'id': '0cd63502-c6d2-5ee0-859b-4632ebb4ef1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN42286',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 54152,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-23',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2023}
2026-03-28 12:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN42286%27 HTTP/1.1" 200 None
2026-03-28 12:09:24 [auto1.it] INFO: Saving data for WN42286: {'auction_closing_time': 1774714738.0, 'created_time': 1774101943.091156, 'last_price_update_time': 1774699764.270867}
2026-03-28 12:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WN42286') HTTP/1.1" 204 0
2026-03-28 12:09:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:09:24 [auto1.it] INFO: Found listing with ID: KM60643
2026-03-28 12:09:24 [auto1.it] INFO: Found listing with ID: LA47308
2026-03-28 12:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA47308%27 HTTP/1.1" 200 None
2026-03-28 12:09:24 [auto1.it] INFO: Scrape type for LA47308: 0
2026-03-28 12:09:24 [auto1.it] INFO: Found listing with ID: WG64225
2026-03-28 12:09:24 [auto1.it] INFO: Found listing with ID: HD23157
2026-03-28 12:09:24 [auto1.it] INFO: Found listing with ID: FM38716
2026-03-28 12:09:24 [auto1.it] INFO: Found listing with ID: LG11183
2026-03-28 12:09:24 [auto1.it] INFO: Found listing with ID: FT05147
2026-03-28 12:09:24 [auto1.it] INFO: Found listing with ID: LC01017
2026-03-28 12:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC01017%27 HTTP/1.1" 200 None
2026-03-28 12:09:24 [auto1.it] INFO: Scrape type for LC01017: 2
2026-03-28 12:09:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6862821a-b65c-5cfe-a7be-64e6ae47273f with identifier: LC01017
2026-03-28 12:09:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6862821a-b65c-5cfe-a7be-64e6ae47273f with scrape type 2
2026-03-28 12:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6862821a-b65c-5cfe-a7be-64e6ae47273f with scrape type 2
2026-03-28 12:09:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6862821a-b65c-5cfe-a7be-64e6ae47273f, identifier: LC01017
2026-03-28 12:09:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6862821a-b65c-5cfe-a7be-64e6ae47273f with identifier: LC01017
2026-03-28 12:09:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6862821a-b65c-5cfe-a7be-64e6ae47273f with identifier: LC01017
2026-03-28 12:09:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6862821a-b65c-5cfe-a7be-64e6ae47273f with identifier: LC01017 to the API
2026-03-28 12:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:56:09Z',
 'fuel_type': 'diesel',
 'id': '6862821a-b65c-5cfe-a7be-64e6ae47273f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC01017',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 212049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-20',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Urban',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Urban',
 'year': 2015}
2026-03-28 12:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC01017%27 HTTP/1.1" 200 None
2026-03-28 12:09:24 [auto1.it] INFO: Saving data for LC01017: {'auction_closing_time': 1774716969.0, 'created_time': 1774515970.181297, 'last_price_update_time': 1774699764.866889}
2026-03-28 12:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LC01017') HTTP/1.1" 204 0
2026-03-28 12:09:24 [auto1.it] INFO: Found listing with ID: MV39692
2026-03-28 12:09:24 [auto1.it] INFO: Found listing with ID: DA96064
2026-03-28 12:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA96064%27 HTTP/1.1" 200 None
2026-03-28 12:09:24 [auto1.it] INFO: Scrape type for DA96064: 0
2026-03-28 12:09:24 [auto1.it] INFO: Found listing with ID: NJ11800
2026-03-28 12:09:24 [auto1.it] INFO: Found listing with ID: CD95874
2026-03-28 12:09:24 [auto1.it] INFO: Found listing with ID: DT73051
2026-03-28 12:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT73051%27 HTTP/1.1" 200 None
2026-03-28 12:09:24 [auto1.it] INFO: Scrape type for DT73051: 0
2026-03-28 12:09:24 [auto1.it] INFO: Found listing with ID: PK63277
2026-03-28 12:09:24 [auto1.it] INFO: Found listing with ID: FK85417
2026-03-28 12:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK85417%27 HTTP/1.1" 200 None
2026-03-28 12:09:24 [auto1.it] INFO: Scrape type for FK85417: 0
2026-03-28 12:09:24 [auto1.it] INFO: Found listing with ID: TF37027
2026-03-28 12:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF37027%27 HTTP/1.1" 200 None
2026-03-28 12:09:24 [auto1.it] INFO: Scrape type for TF37027: 0
2026-03-28 12:09:24 [auto1.it] INFO: Found listing with ID: UU36082
2026-03-28 12:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU36082%27 HTTP/1.1" 200 None
2026-03-28 12:09:24 [auto1.it] INFO: Scrape type for UU36082: 0
2026-03-28 12:09:24 [auto1.it] INFO: Found listing with ID: NS61318
2026-03-28 12:09:24 [auto1.it] INFO: Found listing with ID: WA05631
2026-03-28 12:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA05631%27 HTTP/1.1" 200 None
2026-03-28 12:09:24 [auto1.it] INFO: Scrape type for WA05631: 0
2026-03-28 12:09:24 [auto1.it] INFO: Found listing with ID: MK47318
2026-03-28 12:09:24 [auto1.it] INFO: Found listing with ID: SR34135
2026-03-28 12:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR34135%27 HTTP/1.1" 200 None
2026-03-28 12:09:25 [auto1.it] INFO: Scrape type for SR34135: 0
2026-03-28 12:09:25 [auto1.it] INFO: Found listing with ID: PC99456
2026-03-28 12:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC99456%27 HTTP/1.1" 200 None
2026-03-28 12:09:25 [auto1.it] INFO: Scrape type for PC99456: 0
2026-03-28 12:09:25 [auto1.it] INFO: Found listing with ID: PF34434
2026-03-28 12:09:25 [auto1.it] INFO: Found listing with ID: UY73261
2026-03-28 12:09:25 [auto1.it] INFO: Found listing with ID: DM22709
2026-03-28 12:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DM22709%27 HTTP/1.1" 200 None
2026-03-28 12:09:25 [auto1.it] INFO: Scrape type for DM22709: 0
2026-03-28 12:09:25 [auto1.it] INFO: Found listing with ID: FC30574
2026-03-28 12:09:25 [auto1.it] INFO: Found listing with ID: ND56106
2026-03-28 12:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ND56106%27 HTTP/1.1" 200 None
2026-03-28 12:09:25 [auto1.it] INFO: Scrape type for ND56106: 0
2026-03-28 12:09:25 [auto1.it] INFO: Found listing with ID: JC04494
2026-03-28 12:09:25 [auto1.it] INFO: Found listing with ID: LC40122
2026-03-28 12:09:25 [auto1.it] INFO: Found listing with ID: SU89902
2026-03-28 12:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SU89902%27 HTTP/1.1" 200 None
2026-03-28 12:09:25 [auto1.it] INFO: Scrape type for SU89902: 0
2026-03-28 12:09:25 [auto1.it] INFO: Found listing with ID: VD81489
2026-03-28 12:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VD81489%27 HTTP/1.1" 200 None
2026-03-28 12:09:25 [auto1.it] INFO: Scrape type for VD81489: 0
2026-03-28 12:09:25 [auto1.it] INFO: Found listing with ID: AY85424
2026-03-28 12:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY85424%27 HTTP/1.1" 200 None
2026-03-28 12:09:25 [auto1.it] INFO: Scrape type for AY85424: 0
2026-03-28 12:09:25 [auto1.it] INFO: Found listing with ID: MF53034
2026-03-28 12:09:25 [auto1.it] INFO: Found listing with ID: AU72091
2026-03-28 12:09:25 [auto1.it] INFO: Found listing with ID: EZ36845
2026-03-28 12:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ36845%27 HTTP/1.1" 200 None
2026-03-28 12:09:25 [auto1.it] INFO: Scrape type for EZ36845: 0
2026-03-28 12:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:09:26 [auto1.it] INFO: Channel: 24h | Page: 59 | totalHits: 3675 | hits on page: 40
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: FR71474
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: NR76329
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: EV83401
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: DJ42894
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: TM24531
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: CW41374
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: UW33297
2026-03-28 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW33297%27 HTTP/1.1" 200 None
2026-03-28 12:09:26 [auto1.it] INFO: Scrape type for UW33297: 0
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: DR27432
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: JJ70536
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: WC74031
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: FH60242
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: HJ29626
2026-03-28 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HJ29626%27 HTTP/1.1" 200 None
2026-03-28 12:09:26 [auto1.it] INFO: Scrape type for HJ29626: 0
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: ZN12664
2026-03-28 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN12664%27 HTTP/1.1" 200 None
2026-03-28 12:09:26 [auto1.it] INFO: Scrape type for ZN12664: 0
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: TW11966
2026-03-28 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW11966%27 HTTP/1.1" 200 None
2026-03-28 12:09:26 [auto1.it] INFO: Scrape type for TW11966: 0
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: FL85946
2026-03-28 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL85946%27 HTTP/1.1" 200 None
2026-03-28 12:09:26 [auto1.it] INFO: Scrape type for FL85946: 0
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: VJ53947
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: DA24771
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: RW18979
2026-03-28 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RW18979%27 HTTP/1.1" 200 None
2026-03-28 12:09:26 [auto1.it] INFO: Scrape type for RW18979: 0
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: YF61167
2026-03-28 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YF61167%27 HTTP/1.1" 200 None
2026-03-28 12:09:26 [auto1.it] INFO: Scrape type for YF61167: 0
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: GJ41533
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: PK33563
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: WG29768
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: EA21058
2026-03-28 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA21058%27 HTTP/1.1" 200 None
2026-03-28 12:09:26 [auto1.it] INFO: Scrape type for EA21058: 0
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: VX99971
2026-03-28 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX99971%27 HTTP/1.1" 200 None
2026-03-28 12:09:26 [auto1.it] INFO: Scrape type for VX99971: 0
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: BP79618
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: WG71791
2026-03-28 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG71791%27 HTTP/1.1" 200 None
2026-03-28 12:09:26 [auto1.it] INFO: Scrape type for WG71791: 0
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: ZY63215
2026-03-28 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY63215%27 HTTP/1.1" 200 None
2026-03-28 12:09:26 [auto1.it] INFO: Scrape type for ZY63215: 0
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: EH99264
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: LB86726
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: XN70596
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: PZ92590
2026-03-28 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ92590%27 HTTP/1.1" 200 None
2026-03-28 12:09:26 [auto1.it] INFO: Scrape type for PZ92590: 0
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: CM44345
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: YW27369
2026-03-28 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW27369%27 HTTP/1.1" 200 None
2026-03-28 12:09:26 [auto1.it] INFO: Scrape type for YW27369: 0
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: SH22668
2026-03-28 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH22668%27 HTTP/1.1" 200 None
2026-03-28 12:09:26 [auto1.it] INFO: Scrape type for SH22668: 0
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: PU31383
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: SM10455
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: ZY20684
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: XY06195
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: VR30636
2026-03-28 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VR30636%27 HTTP/1.1" 200 None
2026-03-28 12:09:26 [auto1.it] INFO: Scrape type for VR30636: 0
2026-03-28 12:09:26 [auto1.it] INFO: Found listing with ID: CK65162
2026-03-28 12:09:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:09:34 [auto1.it] INFO: Channel: 24h | Page: 60 | totalHits: 3675 | hits on page: 40
2026-03-28 12:09:34 [auto1.it] INFO: Found listing with ID: AP21705
2026-03-28 12:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP21705%27 HTTP/1.1" 200 None
2026-03-28 12:09:34 [auto1.it] INFO: Scrape type for AP21705: 0
2026-03-28 12:09:34 [auto1.it] INFO: Found listing with ID: VH38350
2026-03-28 12:09:34 [auto1.it] INFO: Found listing with ID: XC86223
2026-03-28 12:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC86223%27 HTTP/1.1" 200 None
2026-03-28 12:09:34 [auto1.it] INFO: Scrape type for XC86223: 0
2026-03-28 12:09:34 [auto1.it] INFO: Found listing with ID: XU45966
2026-03-28 12:09:34 [auto1.it] INFO: Found listing with ID: NY71286
2026-03-28 12:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY71286%27 HTTP/1.1" 200 None
2026-03-28 12:09:34 [auto1.it] INFO: Scrape type for NY71286: 0
2026-03-28 12:09:34 [auto1.it] INFO: Found listing with ID: RD78006
2026-03-28 12:09:34 [auto1.it] INFO: Found listing with ID: CF61926
2026-03-28 12:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CF61926%27 HTTP/1.1" 200 None
2026-03-28 12:09:34 [auto1.it] INFO: Scrape type for CF61926: 0
2026-03-28 12:09:34 [auto1.it] INFO: Found listing with ID: SL28261
2026-03-28 12:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SL28261%27 HTTP/1.1" 200 None
2026-03-28 12:09:34 [auto1.it] INFO: Scrape type for SL28261: 0
2026-03-28 12:09:34 [auto1.it] INFO: Found listing with ID: XZ72452
2026-03-28 12:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XZ72452%27 HTTP/1.1" 200 None
2026-03-28 12:09:34 [auto1.it] INFO: Scrape type for XZ72452: 0
2026-03-28 12:09:34 [auto1.it] INFO: Found listing with ID: CT62115
2026-03-28 12:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT62115%27 HTTP/1.1" 200 None
2026-03-28 12:09:34 [auto1.it] INFO: Scrape type for CT62115: 0
2026-03-28 12:09:34 [auto1.it] INFO: Found listing with ID: NA19420
2026-03-28 12:09:34 [auto1.it] INFO: Found listing with ID: UH10100
2026-03-28 12:09:34 [auto1.it] INFO: Found listing with ID: DW12777
2026-03-28 12:09:34 [auto1.it] INFO: Found listing with ID: PW61851
2026-03-28 12:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW61851%27 HTTP/1.1" 200 None
2026-03-28 12:09:34 [auto1.it] INFO: Scrape type for PW61851: 0
2026-03-28 12:09:34 [auto1.it] INFO: Found listing with ID: LK86303
2026-03-28 12:09:34 [auto1.it] INFO: Found listing with ID: YU91907
2026-03-28 12:09:34 [auto1.it] INFO: Found listing with ID: FR09226
2026-03-28 12:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR09226%27 HTTP/1.1" 200 None
2026-03-28 12:09:34 [auto1.it] INFO: Scrape type for FR09226: 0
2026-03-28 12:09:34 [auto1.it] INFO: Found listing with ID: TZ10573
2026-03-28 12:09:34 [auto1.it] INFO: Found listing with ID: DP88225
2026-03-28 12:09:34 [auto1.it] INFO: Found listing with ID: LL55379
2026-03-28 12:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LL55379%27 HTTP/1.1" 200 None
2026-03-28 12:09:35 [auto1.it] INFO: Scrape type for LL55379: 0
2026-03-28 12:09:35 [auto1.it] INFO: Found listing with ID: EP71722
2026-03-28 12:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP71722%27 HTTP/1.1" 200 None
2026-03-28 12:09:35 [auto1.it] INFO: Scrape type for EP71722: 0
2026-03-28 12:09:35 [auto1.it] INFO: Found listing with ID: RS77350
2026-03-28 12:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS77350%27 HTTP/1.1" 200 None
2026-03-28 12:09:35 [auto1.it] INFO: Scrape type for RS77350: 0
2026-03-28 12:09:35 [auto1.it] INFO: Found listing with ID: DN48840
2026-03-28 12:09:35 [auto1.it] INFO: Found listing with ID: SG58934
2026-03-28 12:09:35 [auto1.it] INFO: Found listing with ID: FK20941
2026-03-28 12:09:35 [auto1.it] INFO: Found listing with ID: XN27965
2026-03-28 12:09:35 [auto1.it] INFO: Found listing with ID: JZ39412
2026-03-28 12:09:35 [auto1.it] INFO: Found listing with ID: XM00417
2026-03-28 12:09:35 [auto1.it] INFO: Found listing with ID: DT20429
2026-03-28 12:09:35 [auto1.it] INFO: Found listing with ID: WY52867
2026-03-28 12:09:35 [auto1.it] INFO: Found listing with ID: RK63045
2026-03-28 12:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK63045%27 HTTP/1.1" 200 None
2026-03-28 12:09:35 [auto1.it] INFO: Scrape type for RK63045: 0
2026-03-28 12:09:35 [auto1.it] INFO: Found listing with ID: AN53744
2026-03-28 12:09:35 [auto1.it] INFO: Found listing with ID: ZL03111
2026-03-28 12:09:35 [auto1.it] INFO: Found listing with ID: CR51689
2026-03-28 12:09:35 [auto1.it] INFO: Found listing with ID: GJ25112
2026-03-28 12:09:35 [auto1.it] INFO: Found listing with ID: LP93747
2026-03-28 12:09:35 [auto1.it] INFO: Found listing with ID: PE19282
2026-03-28 12:09:35 [auto1.it] INFO: Found listing with ID: CL45076
2026-03-28 12:09:35 [auto1.it] INFO: Found listing with ID: PG35916
2026-03-28 12:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PG35916%27 HTTP/1.1" 200 None
2026-03-28 12:09:35 [auto1.it] INFO: Scrape type for PG35916: 0
2026-03-28 12:09:35 [auto1.it] INFO: Found listing with ID: ZU55509
2026-03-28 12:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU55509%27 HTTP/1.1" 200 None
2026-03-28 12:09:35 [auto1.it] INFO: Scrape type for ZU55509: 0
2026-03-28 12:09:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:09:36 [auto1.it] INFO: Channel: 24h | Page: 61 | totalHits: 3675 | hits on page: 40
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: EC84941
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC84941%27 HTTP/1.1" 200 None
2026-03-28 12:09:36 [auto1.it] INFO: Scrape type for EC84941: 0
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: ZN80284
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: ZL81271
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL81271%27 HTTP/1.1" 200 None
2026-03-28 12:09:36 [auto1.it] INFO: Scrape type for ZL81271: 0
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: RV64842
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: XW64768
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: GY24745
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY24745%27 HTTP/1.1" 200 None
2026-03-28 12:09:36 [auto1.it] INFO: Scrape type for GY24745: 0
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: WG32639
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG32639%27 HTTP/1.1" 200 None
2026-03-28 12:09:36 [auto1.it] INFO: Scrape type for WG32639: 0
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: KA78119
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA78119%27 HTTP/1.1" 200 None
2026-03-28 12:09:36 [auto1.it] INFO: Scrape type for KA78119: 0
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: KT00361
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT00361%27 HTTP/1.1" 200 None
2026-03-28 12:09:36 [auto1.it] INFO: Scrape type for KT00361: 0
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: DB99572
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB99572%27 HTTP/1.1" 200 None
2026-03-28 12:09:36 [auto1.it] INFO: Scrape type for DB99572: 0
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: ZS75876
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS75876%27 HTTP/1.1" 200 None
2026-03-28 12:09:36 [auto1.it] INFO: Scrape type for ZS75876: 0
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: XR19887
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR19887%27 HTTP/1.1" 200 None
2026-03-28 12:09:36 [auto1.it] INFO: Scrape type for XR19887: 0
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: UW96033
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: UN43339
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN43339%27 HTTP/1.1" 200 None
2026-03-28 12:09:36 [auto1.it] INFO: Scrape type for UN43339: 0
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: DM22162
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: VF71012
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: DT03603
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT03603%27 HTTP/1.1" 200 None
2026-03-28 12:09:36 [auto1.it] INFO: Scrape type for DT03603: 0
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: AN46326
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: ZT86767
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: DB04877
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: CE88274
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE88274%27 HTTP/1.1" 200 None
2026-03-28 12:09:36 [auto1.it] INFO: Scrape type for CE88274: 0
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: GY86444
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: LB78723
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: KB64117
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: HB85992
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: WP02751
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: KB32662
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KB32662%27 HTTP/1.1" 200 None
2026-03-28 12:09:36 [auto1.it] INFO: Scrape type for KB32662: 0
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: CM16503
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: CV26562
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV26562%27 HTTP/1.1" 200 None
2026-03-28 12:09:36 [auto1.it] INFO: Scrape type for CV26562: 0
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: LV27017
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: PW98934
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW98934%27 HTTP/1.1" 200 None
2026-03-28 12:09:36 [auto1.it] INFO: Scrape type for PW98934: 0
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: PZ48613
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ48613%27 HTTP/1.1" 200 None
2026-03-28 12:09:36 [auto1.it] INFO: Scrape type for PZ48613: 0
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: MR45258
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: WG08894
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG08894%27 HTTP/1.1" 200 None
2026-03-28 12:09:36 [auto1.it] INFO: Scrape type for WG08894: 0
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: HF76476
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF76476%27 HTTP/1.1" 200 None
2026-03-28 12:09:36 [auto1.it] INFO: Scrape type for HF76476: 0
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: TY18364
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY18364%27 HTTP/1.1" 200 None
2026-03-28 12:09:36 [auto1.it] INFO: Scrape type for TY18364: 0
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: NK56802
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: NV82845
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: PM77932
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM77932%27 HTTP/1.1" 200 None
2026-03-28 12:09:36 [auto1.it] INFO: Scrape type for PM77932: 0
2026-03-28 12:09:36 [auto1.it] INFO: Found listing with ID: NC51724
2026-03-28 12:09:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:09:38 [auto1.it] INFO: Channel: 24h | Page: 62 | totalHits: 3675 | hits on page: 40
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: GZ60590
2026-03-28 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ60590%27 HTTP/1.1" 200 None
2026-03-28 12:09:38 [auto1.it] INFO: Scrape type for GZ60590: 0
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: UA61069
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: PB72674
2026-03-28 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PB72674%27 HTTP/1.1" 200 None
2026-03-28 12:09:38 [auto1.it] INFO: Scrape type for PB72674: 0
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: GS07587
2026-03-28 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GS07587%27 HTTP/1.1" 200 None
2026-03-28 12:09:38 [auto1.it] INFO: Scrape type for GS07587: 0
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: VJ15717
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: FA85590
2026-03-28 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA85590%27 HTTP/1.1" 200 None
2026-03-28 12:09:38 [auto1.it] INFO: Scrape type for FA85590: 0
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: DW71358
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: VC28082
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: MA80694
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: JP88345
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: HM97674
2026-03-28 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HM97674%27 HTTP/1.1" 200 None
2026-03-28 12:09:38 [auto1.it] INFO: Scrape type for HM97674: 0
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: UF13738
2026-03-28 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UF13738%27 HTTP/1.1" 200 None
2026-03-28 12:09:38 [auto1.it] INFO: Scrape type for UF13738: 0
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: RP10798
2026-03-28 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RP10798%27 HTTP/1.1" 200 None
2026-03-28 12:09:38 [auto1.it] INFO: Scrape type for RP10798: 0
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: NK13523
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: DF73154
2026-03-28 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF73154%27 HTTP/1.1" 200 None
2026-03-28 12:09:38 [auto1.it] INFO: Scrape type for DF73154: 0
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: BH85641
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: JH70368
2026-03-28 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH70368%27 HTTP/1.1" 200 None
2026-03-28 12:09:38 [auto1.it] INFO: Scrape type for JH70368: 0
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: RF82114
2026-03-28 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF82114%27 HTTP/1.1" 200 None
2026-03-28 12:09:38 [auto1.it] INFO: Scrape type for RF82114: 0
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: YS98054
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: TD98171
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: RG82226
2026-03-28 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG82226%27 HTTP/1.1" 200 None
2026-03-28 12:09:38 [auto1.it] INFO: Scrape type for RG82226: 0
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: HS01763
2026-03-28 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS01763%27 HTTP/1.1" 200 None
2026-03-28 12:09:38 [auto1.it] INFO: Scrape type for HS01763: 0
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: HS85648
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: UC01773
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: ZV58496
2026-03-28 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV58496%27 HTTP/1.1" 200 None
2026-03-28 12:09:38 [auto1.it] INFO: Scrape type for ZV58496: 0
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: ZE54964
2026-03-28 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE54964%27 HTTP/1.1" 200 None
2026-03-28 12:09:38 [auto1.it] INFO: Scrape type for ZE54964: 0
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: TG01095
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: BL33415
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: FG93356
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: LD09745
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: FZ53517
2026-03-28 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FZ53517%27 HTTP/1.1" 200 None
2026-03-28 12:09:38 [auto1.it] INFO: Scrape type for FZ53517: 0
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: ED44758
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: FM26794
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: MA29879
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: RP11137
2026-03-28 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RP11137%27 HTTP/1.1" 200 None
2026-03-28 12:09:38 [auto1.it] INFO: Scrape type for RP11137: 0
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: YU18545
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: BT34353
2026-03-28 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT34353%27 HTTP/1.1" 200 None
2026-03-28 12:09:38 [auto1.it] INFO: Scrape type for BT34353: 0
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: MV84060
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: XH21917
2026-03-28 12:09:38 [auto1.it] INFO: Found listing with ID: CV60051
2026-03-28 12:09:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:09:39 [auto1.it] INFO: Channel: 24h | Page: 63 | totalHits: 3675 | hits on page: 40
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: BN63914
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: RM66243
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM66243%27 HTTP/1.1" 200 None
2026-03-28 12:09:39 [auto1.it] INFO: Scrape type for RM66243: 0
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: XF07692
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF07692%27 HTTP/1.1" 200 None
2026-03-28 12:09:39 [auto1.it] INFO: Scrape type for XF07692: 0
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: FC82856
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC82856%27 HTTP/1.1" 200 None
2026-03-28 12:09:39 [auto1.it] INFO: Scrape type for FC82856: 0
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: LH93951
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH93951%27 HTTP/1.1" 200 None
2026-03-28 12:09:39 [auto1.it] INFO: Scrape type for LH93951: 0
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: YL53737
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: BW34835
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: NC75436
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC75436%27 HTTP/1.1" 200 None
2026-03-28 12:09:39 [auto1.it] INFO: Scrape type for NC75436: 0
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: ZZ37301
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ37301%27 HTTP/1.1" 200 None
2026-03-28 12:09:39 [auto1.it] INFO: Scrape type for ZZ37301: 0
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: ED49512
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED49512%27 HTTP/1.1" 200 None
2026-03-28 12:09:39 [auto1.it] INFO: Scrape type for ED49512: 0
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: PP30320
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP30320%27 HTTP/1.1" 200 None
2026-03-28 12:09:39 [auto1.it] INFO: Scrape type for PP30320: 0
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: GU13900
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: LX88559
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: DR08334
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR08334%27 HTTP/1.1" 200 None
2026-03-28 12:09:39 [auto1.it] INFO: Scrape type for DR08334: 0
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: JL50472
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: PA95874
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA95874%27 HTTP/1.1" 200 None
2026-03-28 12:09:39 [auto1.it] INFO: Scrape type for PA95874: 0
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: KW91343
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: MG56824
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG56824%27 HTTP/1.1" 200 None
2026-03-28 12:09:39 [auto1.it] INFO: Scrape type for MG56824: 0
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: ZC61191
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: BE98345
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: KF16617
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF16617%27 HTTP/1.1" 200 None
2026-03-28 12:09:39 [auto1.it] INFO: Scrape type for KF16617: 0
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: CF46707
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: PW55510
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: HH63511
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH63511%27 HTTP/1.1" 200 None
2026-03-28 12:09:39 [auto1.it] INFO: Scrape type for HH63511: 0
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: XB83607
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: TX19342
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: FG48164
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG48164%27 HTTP/1.1" 200 None
2026-03-28 12:09:39 [auto1.it] INFO: Scrape type for FG48164: 0
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: WD01397
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: MZ58050
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: PT91804
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT91804%27 HTTP/1.1" 200 None
2026-03-28 12:09:39 [auto1.it] INFO: Scrape type for PT91804: 0
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: WA90639
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA90639%27 HTTP/1.1" 200 None
2026-03-28 12:09:39 [auto1.it] INFO: Scrape type for WA90639: 0
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: WT06044
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: RW29335
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RW29335%27 HTTP/1.1" 200 None
2026-03-28 12:09:39 [auto1.it] INFO: Scrape type for RW29335: 0
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: LL12083
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LL12083%27 HTTP/1.1" 200 None
2026-03-28 12:09:39 [auto1.it] INFO: Scrape type for LL12083: 0
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: RV05928
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV05928%27 HTTP/1.1" 200 None
2026-03-28 12:09:39 [auto1.it] INFO: Scrape type for RV05928: 0
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: TH12767
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH12767%27 HTTP/1.1" 200 None
2026-03-28 12:09:39 [auto1.it] INFO: Scrape type for TH12767: 0
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: PM18246
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM18246%27 HTTP/1.1" 200 None
2026-03-28 12:09:39 [auto1.it] INFO: Scrape type for PM18246: 0
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: WD56351
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD56351%27 HTTP/1.1" 200 None
2026-03-28 12:09:39 [auto1.it] INFO: Scrape type for WD56351: 0
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: JT98079
2026-03-28 12:09:39 [auto1.it] INFO: Found listing with ID: CC30639
2026-03-28 12:09:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:09:40 [auto1.it] INFO: Channel: 24h | Page: 64 | totalHits: 3675 | hits on page: 40
2026-03-28 12:09:40 [auto1.it] INFO: Found listing with ID: HX11977
2026-03-28 12:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HX11977%27 HTTP/1.1" 200 None
2026-03-28 12:09:40 [auto1.it] INFO: Scrape type for HX11977: 0
2026-03-28 12:09:40 [auto1.it] INFO: Found listing with ID: DP76328
2026-03-28 12:09:40 [auto1.it] INFO: Found listing with ID: AW58556
2026-03-28 12:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW58556%27 HTTP/1.1" 200 None
2026-03-28 12:09:40 [auto1.it] INFO: Scrape type for AW58556: 0
2026-03-28 12:09:40 [auto1.it] INFO: Found listing with ID: PV15987
2026-03-28 12:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV15987%27 HTTP/1.1" 200 None
2026-03-28 12:09:40 [auto1.it] INFO: Scrape type for PV15987: 0
2026-03-28 12:09:40 [auto1.it] INFO: Found listing with ID: CL12006
2026-03-28 12:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CL12006%27 HTTP/1.1" 200 None
2026-03-28 12:09:40 [auto1.it] INFO: Scrape type for CL12006: 0
2026-03-28 12:09:40 [auto1.it] INFO: Found listing with ID: JF71307
2026-03-28 12:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF71307%27 HTTP/1.1" 200 None
2026-03-28 12:09:40 [auto1.it] INFO: Scrape type for JF71307: 0
2026-03-28 12:09:40 [auto1.it] INFO: Found listing with ID: DZ84756
2026-03-28 12:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ84756%27 HTTP/1.1" 200 None
2026-03-28 12:09:40 [auto1.it] INFO: Scrape type for DZ84756: 0
2026-03-28 12:09:40 [auto1.it] INFO: Found listing with ID: MS56995
2026-03-28 12:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MS56995%27 HTTP/1.1" 200 None
2026-03-28 12:09:40 [auto1.it] INFO: Scrape type for MS56995: 0
2026-03-28 12:09:40 [auto1.it] INFO: Found listing with ID: GL66582
2026-03-28 12:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL66582%27 HTTP/1.1" 200 None
2026-03-28 12:09:40 [auto1.it] INFO: Scrape type for GL66582: 0
2026-03-28 12:09:40 [auto1.it] INFO: Found listing with ID: CY86412
2026-03-28 12:09:40 [auto1.it] INFO: Found listing with ID: UF72432
2026-03-28 12:09:40 [auto1.it] INFO: Found listing with ID: MY33245
2026-03-28 12:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MY33245%27 HTTP/1.1" 200 None
2026-03-28 12:09:41 [auto1.it] INFO: Scrape type for MY33245: 0
2026-03-28 12:09:41 [auto1.it] INFO: Found listing with ID: AJ60776
2026-03-28 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AJ60776%27 HTTP/1.1" 200 None
2026-03-28 12:09:41 [auto1.it] INFO: Scrape type for AJ60776: 0
2026-03-28 12:09:41 [auto1.it] INFO: Found listing with ID: TY10894
2026-03-28 12:09:41 [auto1.it] INFO: Found listing with ID: XE78357
2026-03-28 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE78357%27 HTTP/1.1" 200 None
2026-03-28 12:09:41 [auto1.it] INFO: Scrape type for XE78357: 0
2026-03-28 12:09:41 [auto1.it] INFO: Found listing with ID: JK74619
2026-03-28 12:09:41 [auto1.it] INFO: Found listing with ID: MP43347
2026-03-28 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP43347%27 HTTP/1.1" 200 None
2026-03-28 12:09:41 [auto1.it] INFO: Scrape type for MP43347: 0
2026-03-28 12:09:41 [auto1.it] INFO: Found listing with ID: PW94321
2026-03-28 12:09:41 [auto1.it] INFO: Found listing with ID: TW74539
2026-03-28 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW74539%27 HTTP/1.1" 200 None
2026-03-28 12:09:41 [auto1.it] INFO: Scrape type for TW74539: 0
2026-03-28 12:09:41 [auto1.it] INFO: Found listing with ID: VA19442
2026-03-28 12:09:41 [auto1.it] INFO: Found listing with ID: TE58119
2026-03-28 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TE58119%27 HTTP/1.1" 200 None
2026-03-28 12:09:41 [auto1.it] INFO: Scrape type for TE58119: 0
2026-03-28 12:09:41 [auto1.it] INFO: Found listing with ID: JE47359
2026-03-28 12:09:41 [auto1.it] INFO: Found listing with ID: UN82812
2026-03-28 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN82812%27 HTTP/1.1" 200 None
2026-03-28 12:09:41 [auto1.it] INFO: Scrape type for UN82812: 0
2026-03-28 12:09:41 [auto1.it] INFO: Found listing with ID: AG84200
2026-03-28 12:09:41 [auto1.it] INFO: Found listing with ID: NY32354
2026-03-28 12:09:41 [auto1.it] INFO: Found listing with ID: SJ01004
2026-03-28 12:09:41 [auto1.it] INFO: Found listing with ID: LT40503
2026-03-28 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LT40503%27 HTTP/1.1" 200 None
2026-03-28 12:09:41 [auto1.it] INFO: Scrape type for LT40503: 0
2026-03-28 12:09:41 [auto1.it] INFO: Found listing with ID: WM11657
2026-03-28 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM11657%27 HTTP/1.1" 200 None
2026-03-28 12:09:41 [auto1.it] INFO: Scrape type for WM11657: 0
2026-03-28 12:09:41 [auto1.it] INFO: Found listing with ID: UE69721
2026-03-28 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UE69721%27 HTTP/1.1" 200 None
2026-03-28 12:09:41 [auto1.it] INFO: Scrape type for UE69721: 0
2026-03-28 12:09:41 [auto1.it] INFO: Found listing with ID: RU03062
2026-03-28 12:09:41 [auto1.it] INFO: Found listing with ID: JM45525
2026-03-28 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM45525%27 HTTP/1.1" 200 None
2026-03-28 12:09:41 [auto1.it] INFO: Scrape type for JM45525: 0
2026-03-28 12:09:41 [auto1.it] INFO: Found listing with ID: LK41226
2026-03-28 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LK41226%27 HTTP/1.1" 200 None
2026-03-28 12:09:41 [auto1.it] INFO: Scrape type for LK41226: 0
2026-03-28 12:09:41 [auto1.it] INFO: Found listing with ID: PY67809
2026-03-28 12:09:41 [auto1.it] INFO: Found listing with ID: AR75288
2026-03-28 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR75288%27 HTTP/1.1" 200 None
2026-03-28 12:09:41 [auto1.it] INFO: Scrape type for AR75288: 0
2026-03-28 12:09:41 [auto1.it] INFO: Found listing with ID: CC38262
2026-03-28 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC38262%27 HTTP/1.1" 200 None
2026-03-28 12:09:41 [auto1.it] INFO: Scrape type for CC38262: 0
2026-03-28 12:09:41 [auto1.it] INFO: Found listing with ID: ZJ87985
2026-03-28 12:09:41 [auto1.it] INFO: Found listing with ID: MK10556
2026-03-28 12:09:41 [auto1.it] INFO: Found listing with ID: YD65738
2026-03-28 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD65738%27 HTTP/1.1" 200 None
2026-03-28 12:09:41 [auto1.it] INFO: Scrape type for YD65738: 0
2026-03-28 12:09:41 [auto1.it] INFO: Found listing with ID: TK22539
2026-03-28 12:09:41 [auto1.it] INFO: Found listing with ID: GM28799
2026-03-28 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM28799%27 HTTP/1.1" 200 None
2026-03-28 12:09:41 [auto1.it] INFO: Scrape type for GM28799: 0
2026-03-28 12:09:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:09:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:09:42 [auto1.it] INFO: Channel: 24h | Page: 65 | totalHits: 3675 | hits on page: 40
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: WL47610
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: NP40750
2026-03-28 12:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP40750%27 HTTP/1.1" 200 None
2026-03-28 12:09:42 [auto1.it] INFO: Scrape type for NP40750: 0
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: AA65111
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: RG08940
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: FL08980
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: DU09881
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: FL90232
2026-03-28 12:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL90232%27 HTTP/1.1" 200 None
2026-03-28 12:09:42 [auto1.it] INFO: Scrape type for FL90232: 0
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: DD75867
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: SK41395
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: TU59296
2026-03-28 12:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU59296%27 HTTP/1.1" 200 None
2026-03-28 12:09:42 [auto1.it] INFO: Scrape type for TU59296: 0
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: PR98561
2026-03-28 12:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR98561%27 HTTP/1.1" 200 None
2026-03-28 12:09:42 [auto1.it] INFO: Scrape type for PR98561: 0
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: AY33190
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: CN85628
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: AA13192
2026-03-28 12:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AA13192%27 HTTP/1.1" 200 None
2026-03-28 12:09:42 [auto1.it] INFO: Scrape type for AA13192: 0
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: BX20882
2026-03-28 12:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX20882%27 HTTP/1.1" 200 None
2026-03-28 12:09:42 [auto1.it] INFO: Scrape type for BX20882: 0
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: SD99760
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: UZ55357
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: CD59978
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: TY61219
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: UT42979
2026-03-28 12:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT42979%27 HTTP/1.1" 200 None
2026-03-28 12:09:42 [auto1.it] INFO: Scrape type for UT42979: 0
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: EZ12960
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: HY18936
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: CV95594
2026-03-28 12:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV95594%27 HTTP/1.1" 200 None
2026-03-28 12:09:42 [auto1.it] INFO: Scrape type for CV95594: 0
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: LG34418
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: AY77506
2026-03-28 12:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY77506%27 HTTP/1.1" 200 None
2026-03-28 12:09:42 [auto1.it] INFO: Scrape type for AY77506: 0
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: KH49254
2026-03-28 12:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KH49254%27 HTTP/1.1" 200 None
2026-03-28 12:09:42 [auto1.it] INFO: Scrape type for KH49254: 0
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: RM05411
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: PW10693
2026-03-28 12:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW10693%27 HTTP/1.1" 200 None
2026-03-28 12:09:42 [auto1.it] INFO: Scrape type for PW10693: 0
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: DC13549
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: WX66376
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: SY39981
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: MD08971
2026-03-28 12:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD08971%27 HTTP/1.1" 200 None
2026-03-28 12:09:42 [auto1.it] INFO: Scrape type for MD08971: 0
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: ZW42216
2026-03-28 12:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW42216%27 HTTP/1.1" 200 None
2026-03-28 12:09:42 [auto1.it] INFO: Scrape type for ZW42216: 0
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: BX71767
2026-03-28 12:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX71767%27 HTTP/1.1" 200 None
2026-03-28 12:09:42 [auto1.it] INFO: Scrape type for BX71767: 0
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: GP73012
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: XG67662
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: EJ77874
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: VX04337
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: BK28378
2026-03-28 12:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BK28378%27 HTTP/1.1" 200 None
2026-03-28 12:09:42 [auto1.it] INFO: Scrape type for BK28378: 0
2026-03-28 12:09:42 [auto1.it] INFO: Found listing with ID: JC85025
2026-03-28 12:09:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:09:43 [auto1.it] INFO: Channel: 24h | Page: 66 | totalHits: 3675 | hits on page: 40
2026-03-28 12:09:43 [auto1.it] INFO: Found listing with ID: YD48620
2026-03-28 12:09:43 [auto1.it] INFO: Found listing with ID: WZ23561
2026-03-28 12:09:43 [auto1.it] INFO: Found listing with ID: CA31078
2026-03-28 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA31078%27 HTTP/1.1" 200 None
2026-03-28 12:09:43 [auto1.it] INFO: Scrape type for CA31078: 0
2026-03-28 12:09:43 [auto1.it] INFO: Found listing with ID: DX25254
2026-03-28 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX25254%27 HTTP/1.1" 200 None
2026-03-28 12:09:43 [auto1.it] INFO: Scrape type for DX25254: 0
2026-03-28 12:09:43 [auto1.it] INFO: Found listing with ID: RN28631
2026-03-28 12:09:43 [auto1.it] INFO: Found listing with ID: KD79727
2026-03-28 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD79727%27 HTTP/1.1" 200 None
2026-03-28 12:09:43 [auto1.it] INFO: Scrape type for KD79727: 0
2026-03-28 12:09:43 [auto1.it] INFO: Found listing with ID: GV78603
2026-03-28 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV78603%27 HTTP/1.1" 200 None
2026-03-28 12:09:43 [auto1.it] INFO: Scrape type for GV78603: 0
2026-03-28 12:09:43 [auto1.it] INFO: Found listing with ID: JD36680
2026-03-28 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD36680%27 HTTP/1.1" 200 None
2026-03-28 12:09:43 [auto1.it] INFO: Scrape type for JD36680: 0
2026-03-28 12:09:43 [auto1.it] INFO: Found listing with ID: HB10468
2026-03-28 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HB10468%27 HTTP/1.1" 200 None
2026-03-28 12:09:43 [auto1.it] INFO: Scrape type for HB10468: 0
2026-03-28 12:09:43 [auto1.it] INFO: Found listing with ID: RA38886
2026-03-28 12:09:43 [auto1.it] INFO: Found listing with ID: EH45262
2026-03-28 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH45262%27 HTTP/1.1" 200 None
2026-03-28 12:09:43 [auto1.it] INFO: Scrape type for EH45262: 0
2026-03-28 12:09:43 [auto1.it] INFO: Found listing with ID: SK02509
2026-03-28 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK02509%27 HTTP/1.1" 200 None
2026-03-28 12:09:43 [auto1.it] INFO: Scrape type for SK02509: 0
2026-03-28 12:09:43 [auto1.it] INFO: Found listing with ID: RJ33574
2026-03-28 12:09:43 [auto1.it] INFO: Found listing with ID: YX30570
2026-03-28 12:09:43 [auto1.it] INFO: Found listing with ID: WP88184
2026-03-28 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP88184%27 HTTP/1.1" 200 None
2026-03-28 12:09:43 [auto1.it] INFO: Scrape type for WP88184: 0
2026-03-28 12:09:43 [auto1.it] INFO: Found listing with ID: ZG90138
2026-03-28 12:09:43 [auto1.it] INFO: Found listing with ID: TM53494
2026-03-28 12:09:43 [auto1.it] INFO: Found listing with ID: BZ06099
2026-03-28 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ06099%27 HTTP/1.1" 200 None
2026-03-28 12:09:43 [auto1.it] INFO: Scrape type for BZ06099: 0
2026-03-28 12:09:43 [auto1.it] INFO: Found listing with ID: KB16454
2026-03-28 12:09:43 [auto1.it] INFO: Found listing with ID: FE09970
2026-03-28 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FE09970%27 HTTP/1.1" 200 None
2026-03-28 12:09:43 [auto1.it] INFO: Scrape type for FE09970: 0
2026-03-28 12:09:43 [auto1.it] INFO: Found listing with ID: XW11641
2026-03-28 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW11641%27 HTTP/1.1" 200 None
2026-03-28 12:09:43 [auto1.it] INFO: Scrape type for XW11641: 0
2026-03-28 12:09:43 [auto1.it] INFO: Found listing with ID: PK37829
2026-03-28 12:09:43 [auto1.it] INFO: Found listing with ID: LA07616
2026-03-28 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA07616%27 HTTP/1.1" 200 None
2026-03-28 12:09:43 [auto1.it] INFO: Scrape type for LA07616: 0
2026-03-28 12:09:43 [auto1.it] INFO: Found listing with ID: VJ93406
2026-03-28 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ93406%27 HTTP/1.1" 200 None
2026-03-28 12:09:43 [auto1.it] INFO: Scrape type for VJ93406: 0
2026-03-28 12:09:43 [auto1.it] INFO: Found listing with ID: SG11242
2026-03-28 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG11242%27 HTTP/1.1" 200 None
2026-03-28 12:09:43 [auto1.it] INFO: Scrape type for SG11242: 0
2026-03-28 12:09:43 [auto1.it] INFO: Found listing with ID: DM40972
2026-03-28 12:09:43 [auto1.it] INFO: Found listing with ID: ZX94133
2026-03-28 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX94133%27 HTTP/1.1" 200 None
2026-03-28 12:09:44 [auto1.it] INFO: Scrape type for ZX94133: 0
2026-03-28 12:09:44 [auto1.it] INFO: Found listing with ID: VE23835
2026-03-28 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VE23835%27 HTTP/1.1" 200 None
2026-03-28 12:09:44 [auto1.it] INFO: Scrape type for VE23835: 0
2026-03-28 12:09:44 [auto1.it] INFO: Found listing with ID: NW58325
2026-03-28 12:09:44 [auto1.it] INFO: Found listing with ID: MN82158
2026-03-28 12:09:44 [auto1.it] INFO: Found listing with ID: ZC19416
2026-03-28 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC19416%27 HTTP/1.1" 200 None
2026-03-28 12:09:44 [auto1.it] INFO: Scrape type for ZC19416: 0
2026-03-28 12:09:44 [auto1.it] INFO: Found listing with ID: DL31507
2026-03-28 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL31507%27 HTTP/1.1" 200 None
2026-03-28 12:09:44 [auto1.it] INFO: Scrape type for DL31507: 0
2026-03-28 12:09:44 [auto1.it] INFO: Found listing with ID: KT77401
2026-03-28 12:09:44 [auto1.it] INFO: Found listing with ID: XX72612
2026-03-28 12:09:44 [auto1.it] INFO: Found listing with ID: HE91199
2026-03-28 12:09:44 [auto1.it] INFO: Found listing with ID: CW11593
2026-03-28 12:09:44 [auto1.it] INFO: Found listing with ID: DW16027
2026-03-28 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW16027%27 HTTP/1.1" 200 None
2026-03-28 12:09:44 [auto1.it] INFO: Scrape type for DW16027: 0
2026-03-28 12:09:44 [auto1.it] INFO: Found listing with ID: NC12493
2026-03-28 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC12493%27 HTTP/1.1" 200 None
2026-03-28 12:09:44 [auto1.it] INFO: Scrape type for NC12493: 0
2026-03-28 12:09:44 [auto1.it] INFO: Found listing with ID: GD15248
2026-03-28 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD15248%27 HTTP/1.1" 200 None
2026-03-28 12:09:44 [auto1.it] INFO: Scrape type for GD15248: 0
2026-03-28 12:09:44 [auto1.it] INFO: Found listing with ID: TH28502
2026-03-28 12:09:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:09:45 [auto1.it] INFO: Channel: 24h | Page: 67 | totalHits: 3675 | hits on page: 40
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: RJ37840
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ37840%27 HTTP/1.1" 200 None
2026-03-28 12:09:45 [auto1.it] INFO: Scrape type for RJ37840: 0
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: EC99785
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC99785%27 HTTP/1.1" 200 None
2026-03-28 12:09:45 [auto1.it] INFO: Scrape type for EC99785: 0
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: ZZ86621
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ86621%27 HTTP/1.1" 200 None
2026-03-28 12:09:45 [auto1.it] INFO: Scrape type for ZZ86621: 0
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: VT42510
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VT42510%27 HTTP/1.1" 200 None
2026-03-28 12:09:45 [auto1.it] INFO: Scrape type for VT42510: 0
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: LN57194
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN57194%27 HTTP/1.1" 200 None
2026-03-28 12:09:45 [auto1.it] INFO: Scrape type for LN57194: 0
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: PZ63395
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ63395%27 HTTP/1.1" 200 None
2026-03-28 12:09:45 [auto1.it] INFO: Scrape type for PZ63395: 0
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: LG36476
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: DV58522
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV58522%27 HTTP/1.1" 200 None
2026-03-28 12:09:45 [auto1.it] INFO: Scrape type for DV58522: 0
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: YH05705
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: GH85070
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GH85070%27 HTTP/1.1" 200 None
2026-03-28 12:09:45 [auto1.it] INFO: Scrape type for GH85070: 0
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: MN32437
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: UV23225
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: SE74727
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: AY40178
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY40178%27 HTTP/1.1" 200 None
2026-03-28 12:09:45 [auto1.it] INFO: Scrape type for AY40178: 0
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: JD45338
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: MT71865
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: FN81856
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: PH50557
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: GZ99467
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ99467%27 HTTP/1.1" 200 None
2026-03-28 12:09:45 [auto1.it] INFO: Scrape type for GZ99467: 0
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: GN89134
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: FT00845
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: ZU32516
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU32516%27 HTTP/1.1" 200 None
2026-03-28 12:09:45 [auto1.it] INFO: Scrape type for ZU32516: 0
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: HK76451
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK76451%27 HTTP/1.1" 200 None
2026-03-28 12:09:45 [auto1.it] INFO: Scrape type for HK76451: 0
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: VG48139
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG48139%27 HTTP/1.1" 200 None
2026-03-28 12:09:45 [auto1.it] INFO: Scrape type for VG48139: 0
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: CY33103
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: WH17825
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH17825%27 HTTP/1.1" 200 None
2026-03-28 12:09:45 [auto1.it] INFO: Scrape type for WH17825: 0
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: JT23346
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT23346%27 HTTP/1.1" 200 None
2026-03-28 12:09:45 [auto1.it] INFO: Scrape type for JT23346: 0
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: RF43689
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF43689%27 HTTP/1.1" 200 None
2026-03-28 12:09:45 [auto1.it] INFO: Scrape type for RF43689: 0
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: FK45797
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK45797%27 HTTP/1.1" 200 None
2026-03-28 12:09:45 [auto1.it] INFO: Scrape type for FK45797: 0
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: GW83806
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW83806%27 HTTP/1.1" 200 None
2026-03-28 12:09:45 [auto1.it] INFO: Scrape type for GW83806: 0
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: PH45617
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: XT40512
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: CM50151
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: KL55117
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: KD38461
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD38461%27 HTTP/1.1" 200 None
2026-03-28 12:09:45 [auto1.it] INFO: Scrape type for KD38461: 0
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: XU37749
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: WV44347
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: YG18020
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG18020%27 HTTP/1.1" 200 None
2026-03-28 12:09:45 [auto1.it] INFO: Scrape type for YG18020: 0
2026-03-28 12:09:45 [auto1.it] INFO: Found listing with ID: HW85888
2026-03-28 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW85888%27 HTTP/1.1" 200 None
2026-03-28 12:09:46 [auto1.it] INFO: Scrape type for HW85888: 0
2026-03-28 12:09:46 [auto1.it] INFO: Found listing with ID: HA44632
2026-03-28 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA44632%27 HTTP/1.1" 200 None
2026-03-28 12:09:46 [auto1.it] INFO: Scrape type for HA44632: 0
2026-03-28 12:09:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:09:47 [auto1.it] INFO: Channel: 24h | Page: 68 | totalHits: 3675 | hits on page: 40
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: KT79218
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: KD49699
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: ZE21394
2026-03-28 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE21394%27 HTTP/1.1" 200 None
2026-03-28 12:09:47 [auto1.it] INFO: Scrape type for ZE21394: 0
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: NB15044
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: YA54300
2026-03-28 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA54300%27 HTTP/1.1" 200 None
2026-03-28 12:09:47 [auto1.it] INFO: Scrape type for YA54300: 0
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: NX73202
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: BG55667
2026-03-28 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG55667%27 HTTP/1.1" 200 None
2026-03-28 12:09:47 [auto1.it] INFO: Scrape type for BG55667: 0
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: SA71650
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: TN53037
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: TG42626
2026-03-28 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG42626%27 HTTP/1.1" 200 None
2026-03-28 12:09:47 [auto1.it] INFO: Scrape type for TG42626: 0
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: LL94615
2026-03-28 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LL94615%27 HTTP/1.1" 200 None
2026-03-28 12:09:47 [auto1.it] INFO: Scrape type for LL94615: 0
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: YD47870
2026-03-28 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD47870%27 HTTP/1.1" 200 None
2026-03-28 12:09:47 [auto1.it] INFO: Scrape type for YD47870: 0
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: RS41050
2026-03-28 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS41050%27 HTTP/1.1" 200 None
2026-03-28 12:09:47 [auto1.it] INFO: Scrape type for RS41050: 0
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: ET57280
2026-03-28 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET57280%27 HTTP/1.1" 200 None
2026-03-28 12:09:47 [auto1.it] INFO: Scrape type for ET57280: 0
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: BW44627
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: JX68223
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: ZW92714
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: UP17064
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: NN80859
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: UB21320
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: NJ83998
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: MN68461
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: CH31271
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: XX37698
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: FX50490
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: RN44276
2026-03-28 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN44276%27 HTTP/1.1" 200 None
2026-03-28 12:09:47 [auto1.it] INFO: Scrape type for RN44276: 0
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: ST06974
2026-03-28 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST06974%27 HTTP/1.1" 200 None
2026-03-28 12:09:47 [auto1.it] INFO: Scrape type for ST06974: 0
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: TJ46359
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: FA93618
2026-03-28 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA93618%27 HTTP/1.1" 200 None
2026-03-28 12:09:47 [auto1.it] INFO: Scrape type for FA93618: 0
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: KS43685
2026-03-28 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KS43685%27 HTTP/1.1" 200 None
2026-03-28 12:09:47 [auto1.it] INFO: Scrape type for KS43685: 0
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: GX83807
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: YG30728
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: GF63115
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: JB43722
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: PP68116
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: SE79185
2026-03-28 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE79185%27 HTTP/1.1" 200 None
2026-03-28 12:09:47 [auto1.it] INFO: Scrape type for SE79185: 0
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: TT81235
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: CK25903
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: JF07503
2026-03-28 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF07503%27 HTTP/1.1" 200 None
2026-03-28 12:09:47 [auto1.it] INFO: Scrape type for JF07503: 0
2026-03-28 12:09:47 [auto1.it] INFO: Found listing with ID: RV62579
2026-03-28 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV62579%27 HTTP/1.1" 200 None
2026-03-28 12:09:47 [auto1.it] INFO: Scrape type for RV62579: 0
2026-03-28 12:09:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:09:48 [auto1.it] INFO: Channel: 24h | Page: 69 | totalHits: 3675 | hits on page: 40
2026-03-28 12:09:48 [auto1.it] INFO: Found listing with ID: RL62360
2026-03-28 12:09:48 [auto1.it] INFO: Found listing with ID: FD53627
2026-03-28 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD53627%27 HTTP/1.1" 200 None
2026-03-28 12:09:48 [auto1.it] INFO: Scrape type for FD53627: 0
2026-03-28 12:09:48 [auto1.it] INFO: Found listing with ID: DL97052
2026-03-28 12:09:48 [auto1.it] INFO: Found listing with ID: VT42722
2026-03-28 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VT42722%27 HTTP/1.1" 200 None
2026-03-28 12:09:48 [auto1.it] INFO: Scrape type for VT42722: 0
2026-03-28 12:09:48 [auto1.it] INFO: Found listing with ID: AG54549
2026-03-28 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG54549%27 HTTP/1.1" 200 None
2026-03-28 12:09:48 [auto1.it] INFO: Scrape type for AG54549: 0
2026-03-28 12:09:48 [auto1.it] INFO: Found listing with ID: EP88995
2026-03-28 12:09:48 [auto1.it] INFO: Found listing with ID: WK88793
2026-03-28 12:09:48 [auto1.it] INFO: Found listing with ID: FR03346
2026-03-28 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR03346%27 HTTP/1.1" 200 None
2026-03-28 12:09:48 [auto1.it] INFO: Scrape type for FR03346: 0
2026-03-28 12:09:48 [auto1.it] INFO: Found listing with ID: UY39151
2026-03-28 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY39151%27 HTTP/1.1" 200 None
2026-03-28 12:09:48 [auto1.it] INFO: Scrape type for UY39151: 0
2026-03-28 12:09:48 [auto1.it] INFO: Found listing with ID: SP41813
2026-03-28 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP41813%27 HTTP/1.1" 200 None
2026-03-28 12:09:48 [auto1.it] INFO: Scrape type for SP41813: 0
2026-03-28 12:09:48 [auto1.it] INFO: Found listing with ID: VM78443
2026-03-28 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM78443%27 HTTP/1.1" 200 None
2026-03-28 12:09:48 [auto1.it] INFO: Scrape type for VM78443: 0
2026-03-28 12:09:48 [auto1.it] INFO: Found listing with ID: DV39460
2026-03-28 12:09:48 [auto1.it] INFO: Found listing with ID: KE11189
2026-03-28 12:09:48 [auto1.it] INFO: Found listing with ID: EY33952
2026-03-28 12:09:48 [auto1.it] INFO: Found listing with ID: DU17366
2026-03-28 12:09:48 [auto1.it] INFO: Found listing with ID: YB63473
2026-03-28 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB63473%27 HTTP/1.1" 200 None
2026-03-28 12:09:48 [auto1.it] INFO: Scrape type for YB63473: 0
2026-03-28 12:09:48 [auto1.it] INFO: Found listing with ID: SJ00829
2026-03-28 12:09:48 [auto1.it] INFO: Found listing with ID: FY46493
2026-03-28 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FY46493%27 HTTP/1.1" 200 None
2026-03-28 12:09:48 [auto1.it] INFO: Scrape type for FY46493: 0
2026-03-28 12:09:48 [auto1.it] INFO: Found listing with ID: GN74108
2026-03-28 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN74108%27 HTTP/1.1" 200 None
2026-03-28 12:09:48 [auto1.it] INFO: Scrape type for GN74108: 0
2026-03-28 12:09:48 [auto1.it] INFO: Found listing with ID: GF01079
2026-03-28 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GF01079%27 HTTP/1.1" 200 None
2026-03-28 12:09:48 [auto1.it] INFO: Scrape type for GF01079: 0
2026-03-28 12:09:48 [auto1.it] INFO: Found listing with ID: XV16730
2026-03-28 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV16730%27 HTTP/1.1" 200 None
2026-03-28 12:09:48 [auto1.it] INFO: Scrape type for XV16730: 0
2026-03-28 12:09:48 [auto1.it] INFO: Found listing with ID: PV94920
2026-03-28 12:09:48 [auto1.it] INFO: Found listing with ID: ZJ21397
2026-03-28 12:09:48 [auto1.it] INFO: Found listing with ID: CH52447
2026-03-28 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH52447%27 HTTP/1.1" 200 None
2026-03-28 12:09:48 [auto1.it] INFO: Scrape type for CH52447: 2
2026-03-28 12:09:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56d72dce-f8c5-5046-8b0c-3b16e029dc6f with identifier: CH52447
2026-03-28 12:09:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56d72dce-f8c5-5046-8b0c-3b16e029dc6f with scrape type 2
2026-03-28 12:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56d72dce-f8c5-5046-8b0c-3b16e029dc6f with scrape type 2
2026-03-28 12:09:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 56d72dce-f8c5-5046-8b0c-3b16e029dc6f, identifier: CH52447
2026-03-28 12:09:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 56d72dce-f8c5-5046-8b0c-3b16e029dc6f with identifier: CH52447
2026-03-28 12:09:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 56d72dce-f8c5-5046-8b0c-3b16e029dc6f with identifier: CH52447
2026-03-28 12:09:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 56d72dce-f8c5-5046-8b0c-3b16e029dc6f with identifier: CH52447 to the API
2026-03-28 12:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:38:34Z',
 'fuel_type': 'petrol',
 'id': '56d72dce-f8c5-5046-8b0c-3b16e029dc6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH52447',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 213471,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-23',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive passion',
 'year': 2009}
2026-03-28 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH52447%27 HTTP/1.1" 200 None
2026-03-28 12:09:49 [auto1.it] INFO: Saving data for CH52447: {'auction_closing_time': 1774715914.0, 'created_time': 1774515954.579897, 'last_price_update_time': 1774699789.171483}
2026-03-28 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CH52447') HTTP/1.1" 204 0
2026-03-28 12:09:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:09:49 [auto1.it] INFO: Found listing with ID: UA89499
2026-03-28 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA89499%27 HTTP/1.1" 200 None
2026-03-28 12:09:49 [auto1.it] INFO: Scrape type for UA89499: 0
2026-03-28 12:09:49 [auto1.it] INFO: Found listing with ID: WU80477
2026-03-28 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU80477%27 HTTP/1.1" 200 None
2026-03-28 12:09:49 [auto1.it] INFO: Scrape type for WU80477: 0
2026-03-28 12:09:49 [auto1.it] INFO: Found listing with ID: YK06699
2026-03-28 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YK06699%27 HTTP/1.1" 200 None
2026-03-28 12:09:49 [auto1.it] INFO: Scrape type for YK06699: 0
2026-03-28 12:09:49 [auto1.it] INFO: Found listing with ID: DK87302
2026-03-28 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK87302%27 HTTP/1.1" 200 None
2026-03-28 12:09:49 [auto1.it] INFO: Scrape type for DK87302: 0
2026-03-28 12:09:49 [auto1.it] INFO: Found listing with ID: RF27989
2026-03-28 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF27989%27 HTTP/1.1" 200 None
2026-03-28 12:09:49 [auto1.it] INFO: Scrape type for RF27989: 0
2026-03-28 12:09:49 [auto1.it] INFO: Found listing with ID: TV99764
2026-03-28 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TV99764%27 HTTP/1.1" 200 None
2026-03-28 12:09:49 [auto1.it] INFO: Scrape type for TV99764: 0
2026-03-28 12:09:49 [auto1.it] INFO: Found listing with ID: SG31590
2026-03-28 12:09:49 [auto1.it] INFO: Found listing with ID: EA08863
2026-03-28 12:09:49 [auto1.it] INFO: Found listing with ID: HD82423
2026-03-28 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD82423%27 HTTP/1.1" 200 None
2026-03-28 12:09:49 [auto1.it] INFO: Scrape type for HD82423: 0
2026-03-28 12:09:49 [auto1.it] INFO: Found listing with ID: NW60366
2026-03-28 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NW60366%27 HTTP/1.1" 200 None
2026-03-28 12:09:49 [auto1.it] INFO: Scrape type for NW60366: 0
2026-03-28 12:09:49 [auto1.it] INFO: Found listing with ID: UC47461
2026-03-28 12:09:49 [auto1.it] INFO: Found listing with ID: NP37024
2026-03-28 12:09:49 [auto1.it] INFO: Found listing with ID: WV72590
2026-03-28 12:09:49 [auto1.it] INFO: Found listing with ID: DB68692
2026-03-28 12:09:49 [auto1.it] INFO: Found listing with ID: FP20263
2026-03-28 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP20263%27 HTTP/1.1" 200 None
2026-03-28 12:09:49 [auto1.it] INFO: Scrape type for FP20263: 0
2026-03-28 12:09:49 [auto1.it] INFO: Found listing with ID: WM78801
2026-03-28 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM78801%27 HTTP/1.1" 200 None
2026-03-28 12:09:49 [auto1.it] INFO: Scrape type for WM78801: 0
2026-03-28 12:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:09:50 [auto1.it] INFO: Channel: 24h | Page: 70 | totalHits: 3675 | hits on page: 40
2026-03-28 12:09:50 [auto1.it] INFO: Found listing with ID: BR67394
2026-03-28 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR67394%27 HTTP/1.1" 200 None
2026-03-28 12:09:50 [auto1.it] INFO: Scrape type for BR67394: 0
2026-03-28 12:09:50 [auto1.it] INFO: Found listing with ID: KP12391
2026-03-28 12:09:50 [auto1.it] INFO: Found listing with ID: JU67462
2026-03-28 12:09:50 [auto1.it] INFO: Found listing with ID: WE55630
2026-03-28 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WE55630%27 HTTP/1.1" 200 None
2026-03-28 12:09:50 [auto1.it] INFO: Scrape type for WE55630: 0
2026-03-28 12:09:50 [auto1.it] INFO: Found listing with ID: VB70261
2026-03-28 12:09:50 [auto1.it] INFO: Found listing with ID: UX28393
2026-03-28 12:09:50 [auto1.it] INFO: Found listing with ID: JY35916
2026-03-28 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JY35916%27 HTTP/1.1" 200 None
2026-03-28 12:09:50 [auto1.it] INFO: Scrape type for JY35916: 0
2026-03-28 12:09:50 [auto1.it] INFO: Found listing with ID: KZ49625
2026-03-28 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ49625%27 HTTP/1.1" 200 None
2026-03-28 12:09:50 [auto1.it] INFO: Scrape type for KZ49625: 0
2026-03-28 12:09:50 [auto1.it] INFO: Found listing with ID: BA15195
2026-03-28 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA15195%27 HTTP/1.1" 200 None
2026-03-28 12:09:50 [auto1.it] INFO: Scrape type for BA15195: 0
2026-03-28 12:09:50 [auto1.it] INFO: Found listing with ID: FN78187
2026-03-28 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN78187%27 HTTP/1.1" 200 None
2026-03-28 12:09:50 [auto1.it] INFO: Scrape type for FN78187: 0
2026-03-28 12:09:50 [auto1.it] INFO: Found listing with ID: CT25036
2026-03-28 12:09:50 [auto1.it] INFO: Found listing with ID: CV79259
2026-03-28 12:09:50 [auto1.it] INFO: Found listing with ID: WH70643
2026-03-28 12:09:50 [auto1.it] INFO: Found listing with ID: BE00528
2026-03-28 12:09:50 [auto1.it] INFO: Found listing with ID: AD01687
2026-03-28 12:09:50 [auto1.it] INFO: Found listing with ID: YT67370
2026-03-28 12:09:50 [auto1.it] INFO: Found listing with ID: HX75119
2026-03-28 12:09:50 [auto1.it] INFO: Found listing with ID: RU27646
2026-03-28 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU27646%27 HTTP/1.1" 200 None
2026-03-28 12:09:50 [auto1.it] INFO: Scrape type for RU27646: 0
2026-03-28 12:09:50 [auto1.it] INFO: Found listing with ID: CW11036
2026-03-28 12:09:50 [auto1.it] INFO: Found listing with ID: WS86957
2026-03-28 12:09:50 [auto1.it] INFO: Found listing with ID: DN99534
2026-03-28 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN99534%27 HTTP/1.1" 200 None
2026-03-28 12:09:50 [auto1.it] INFO: Scrape type for DN99534: 0
2026-03-28 12:09:50 [auto1.it] INFO: Found listing with ID: FN89798
2026-03-28 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN89798%27 HTTP/1.1" 200 None
2026-03-28 12:09:50 [auto1.it] INFO: Scrape type for FN89798: 0
2026-03-28 12:09:50 [auto1.it] INFO: Found listing with ID: JL83365
2026-03-28 12:09:50 [auto1.it] INFO: Found listing with ID: WH55866
2026-03-28 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH55866%27 HTTP/1.1" 200 None
2026-03-28 12:09:50 [auto1.it] INFO: Scrape type for WH55866: 0
2026-03-28 12:09:50 [auto1.it] INFO: Found listing with ID: AE85133
2026-03-28 12:09:50 [auto1.it] INFO: Found listing with ID: DN08813
2026-03-28 12:09:50 [auto1.it] INFO: Found listing with ID: GP15834
2026-03-28 12:09:50 [auto1.it] INFO: Found listing with ID: YH14903
2026-03-28 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH14903%27 HTTP/1.1" 200 None
2026-03-28 12:09:50 [auto1.it] INFO: Scrape type for YH14903: 2
2026-03-28 12:09:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4d2f8f6-876c-5eeb-bd7c-bed7e90875ea with identifier: YH14903
2026-03-28 12:09:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4d2f8f6-876c-5eeb-bd7c-bed7e90875ea with scrape type 2
2026-03-28 12:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4d2f8f6-876c-5eeb-bd7c-bed7e90875ea with scrape type 2
2026-03-28 12:09:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e4d2f8f6-876c-5eeb-bd7c-bed7e90875ea, identifier: YH14903
2026-03-28 12:09:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e4d2f8f6-876c-5eeb-bd7c-bed7e90875ea with identifier: YH14903
2026-03-28 12:09:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e4d2f8f6-876c-5eeb-bd7c-bed7e90875ea with identifier: YH14903
2026-03-28 12:09:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e4d2f8f6-876c-5eeb-bd7c-bed7e90875ea with identifier: YH14903 to the API
2026-03-28 12:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:30:49Z',
 'fuel_type': 'diesel',
 'id': 'e4d2f8f6-876c-5eeb-bd7c-bed7e90875ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH14903',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 164626,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-30',
 'seller_name': None,
 'title': 'Peugeot 3008 2.0 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2019}
2026-03-28 12:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH14903%27 HTTP/1.1" 200 None
2026-03-28 12:09:51 [auto1.it] INFO: Saving data for YH14903: {'auction_closing_time': 1774715449.0, 'created_time': 1774613207.000293, 'last_price_update_time': 1774699791.094567}
2026-03-28 12:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YH14903') HTTP/1.1" 204 0
2026-03-28 12:09:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:09:51 [auto1.it] INFO: Found listing with ID: BJ71456
2026-03-28 12:09:51 [auto1.it] INFO: Found listing with ID: HC78855
2026-03-28 12:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC78855%27 HTTP/1.1" 200 None
2026-03-28 12:09:51 [auto1.it] INFO: Scrape type for HC78855: 0
2026-03-28 12:09:51 [auto1.it] INFO: Found listing with ID: GM03670
2026-03-28 12:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM03670%27 HTTP/1.1" 200 None
2026-03-28 12:09:51 [auto1.it] INFO: Scrape type for GM03670: 0
2026-03-28 12:09:51 [auto1.it] INFO: Found listing with ID: WY72750
2026-03-28 12:09:51 [auto1.it] INFO: Found listing with ID: ZF40554
2026-03-28 12:09:51 [auto1.it] INFO: Found listing with ID: XY26314
2026-03-28 12:09:51 [auto1.it] INFO: Found listing with ID: PD07113
2026-03-28 12:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD07113%27 HTTP/1.1" 200 None
2026-03-28 12:09:51 [auto1.it] INFO: Scrape type for PD07113: 0
2026-03-28 12:09:51 [auto1.it] INFO: Found listing with ID: NP01679
2026-03-28 12:09:51 [auto1.it] INFO: Found listing with ID: PN01400
2026-03-28 12:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN01400%27 HTTP/1.1" 200 None
2026-03-28 12:09:51 [auto1.it] INFO: Scrape type for PN01400: 0
2026-03-28 12:09:51 [auto1.it] INFO: Found listing with ID: HM54008
2026-03-28 12:09:51 [auto1.it] INFO: Found listing with ID: SP76824
2026-03-28 12:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP76824%27 HTTP/1.1" 200 None
2026-03-28 12:09:51 [auto1.it] INFO: Scrape type for SP76824: 0
2026-03-28 12:09:51 [auto1.it] INFO: Found listing with ID: KM59258
2026-03-28 12:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM59258%27 HTTP/1.1" 200 None
2026-03-28 12:09:51 [auto1.it] INFO: Scrape type for KM59258: 0
2026-03-28 12:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:09:52 [auto1.it] INFO: Channel: 24h | Page: 71 | totalHits: 3675 | hits on page: 40
2026-03-28 12:09:52 [auto1.it] INFO: Found listing with ID: EK35642
2026-03-28 12:09:52 [auto1.it] INFO: Found listing with ID: TS59592
2026-03-28 12:09:52 [auto1.it] INFO: Found listing with ID: GL53946
2026-03-28 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL53946%27 HTTP/1.1" 200 None
2026-03-28 12:09:52 [auto1.it] INFO: Scrape type for GL53946: 0
2026-03-28 12:09:52 [auto1.it] INFO: Found listing with ID: TL14575
2026-03-28 12:09:52 [auto1.it] INFO: Found listing with ID: DC79490
2026-03-28 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC79490%27 HTTP/1.1" 200 None
2026-03-28 12:09:52 [auto1.it] INFO: Scrape type for DC79490: 0
2026-03-28 12:09:52 [auto1.it] INFO: Found listing with ID: KH25019
2026-03-28 12:09:52 [auto1.it] INFO: Found listing with ID: ES64600
2026-03-28 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES64600%27 HTTP/1.1" 200 None
2026-03-28 12:09:52 [auto1.it] INFO: Scrape type for ES64600: 0
2026-03-28 12:09:52 [auto1.it] INFO: Found listing with ID: FL80724
2026-03-28 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL80724%27 HTTP/1.1" 200 None
2026-03-28 12:09:52 [auto1.it] INFO: Scrape type for FL80724: 0
2026-03-28 12:09:52 [auto1.it] INFO: Found listing with ID: KL25988
2026-03-28 12:09:52 [auto1.it] INFO: Found listing with ID: WF71586
2026-03-28 12:09:52 [auto1.it] INFO: Found listing with ID: ZV13161
2026-03-28 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV13161%27 HTTP/1.1" 200 None
2026-03-28 12:09:52 [auto1.it] INFO: Scrape type for ZV13161: 0
2026-03-28 12:09:52 [auto1.it] INFO: Found listing with ID: WX88611
2026-03-28 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WX88611%27 HTTP/1.1" 200 None
2026-03-28 12:09:52 [auto1.it] INFO: Scrape type for WX88611: 0
2026-03-28 12:09:52 [auto1.it] INFO: Found listing with ID: DX82404
2026-03-28 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX82404%27 HTTP/1.1" 200 None
2026-03-28 12:09:52 [auto1.it] INFO: Scrape type for DX82404: 0
2026-03-28 12:09:52 [auto1.it] INFO: Found listing with ID: SC24442
2026-03-28 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC24442%27 HTTP/1.1" 200 None
2026-03-28 12:09:52 [auto1.it] INFO: Scrape type for SC24442: 0
2026-03-28 12:09:52 [auto1.it] INFO: Found listing with ID: JT68367
2026-03-28 12:09:52 [auto1.it] INFO: Found listing with ID: HZ95408
2026-03-28 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HZ95408%27 HTTP/1.1" 200 None
2026-03-28 12:09:52 [auto1.it] INFO: Scrape type for HZ95408: 0
2026-03-28 12:09:52 [auto1.it] INFO: Found listing with ID: KT12037
2026-03-28 12:09:52 [auto1.it] INFO: Found listing with ID: TV86323
2026-03-28 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TV86323%27 HTTP/1.1" 200 None
2026-03-28 12:09:52 [auto1.it] INFO: Scrape type for TV86323: 0
2026-03-28 12:09:52 [auto1.it] INFO: Found listing with ID: JJ76443
2026-03-28 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ76443%27 HTTP/1.1" 200 None
2026-03-28 12:09:52 [auto1.it] INFO: Scrape type for JJ76443: 0
2026-03-28 12:09:52 [auto1.it] INFO: Found listing with ID: YW35893
2026-03-28 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW35893%27 HTTP/1.1" 200 None
2026-03-28 12:09:52 [auto1.it] INFO: Scrape type for YW35893: 0
2026-03-28 12:09:52 [auto1.it] INFO: Found listing with ID: LU63066
2026-03-28 12:09:52 [auto1.it] INFO: Found listing with ID: JG85699
2026-03-28 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JG85699%27 HTTP/1.1" 200 None
2026-03-28 12:09:52 [auto1.it] INFO: Scrape type for JG85699: 0
2026-03-28 12:09:52 [auto1.it] INFO: Found listing with ID: HU57000
2026-03-28 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU57000%27 HTTP/1.1" 200 None
2026-03-28 12:09:52 [auto1.it] INFO: Scrape type for HU57000: 2
2026-03-28 12:09:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c47b7e97-b28a-555c-a34d-cd6d7604253b with identifier: HU57000
2026-03-28 12:09:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c47b7e97-b28a-555c-a34d-cd6d7604253b with scrape type 2
2026-03-28 12:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c47b7e97-b28a-555c-a34d-cd6d7604253b with scrape type 2
2026-03-28 12:09:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c47b7e97-b28a-555c-a34d-cd6d7604253b, identifier: HU57000
2026-03-28 12:09:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c47b7e97-b28a-555c-a34d-cd6d7604253b with identifier: HU57000
2026-03-28 12:09:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c47b7e97-b28a-555c-a34d-cd6d7604253b with identifier: HU57000
2026-03-28 12:09:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c47b7e97-b28a-555c-a34d-cd6d7604253b with identifier: HU57000 to the API
2026-03-28 12:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:30:52Z',
 'fuel_type': 'petrol',
 'id': 'c47b7e97-b28a-555c-a34d-cd6d7604253b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU57000',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Getz',
 'odometer': 112148,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-07-31',
 'seller_name': None,
 'title': 'Hyundai Getz 1.3 GLS',
 'transmission': 'automatic',
 'trim': 'GLS',
 'year': 2003}
2026-03-28 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU57000%27 HTTP/1.1" 200 None
2026-03-28 12:09:52 [auto1.it] INFO: Saving data for HU57000: {'auction_closing_time': 1774715452.0, 'created_time': 1773131755.049369, 'last_price_update_time': 1774699792.947379}
2026-03-28 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HU57000') HTTP/1.1" 204 0
2026-03-28 12:09:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:09:53 [auto1.it] INFO: Found listing with ID: HG91847
2026-03-28 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG91847%27 HTTP/1.1" 200 None
2026-03-28 12:09:53 [auto1.it] INFO: Scrape type for HG91847: 2
2026-03-28 12:09:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2553628-8829-5a4d-9147-8c40a113804f with identifier: HG91847
2026-03-28 12:09:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2553628-8829-5a4d-9147-8c40a113804f with scrape type 2
2026-03-28 12:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2553628-8829-5a4d-9147-8c40a113804f with scrape type 2
2026-03-28 12:09:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b2553628-8829-5a4d-9147-8c40a113804f, identifier: HG91847
2026-03-28 12:09:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b2553628-8829-5a4d-9147-8c40a113804f with identifier: HG91847
2026-03-28 12:09:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b2553628-8829-5a4d-9147-8c40a113804f with identifier: HG91847
2026-03-28 12:09:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b2553628-8829-5a4d-9147-8c40a113804f with identifier: HG91847 to the API
2026-03-28 12:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:20:16Z',
 'fuel_type': 'diesel',
 'id': 'b2553628-8829-5a4d-9147-8c40a113804f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG91847',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Alfa 159',
 'odometer': 248110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-28',
 'seller_name': None,
 'title': 'Alfa Romeo Alfa 159 2.0 JTDM',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG91847%27 HTTP/1.1" 200 None
2026-03-28 12:09:53 [auto1.it] INFO: Saving data for HG91847: {'auction_closing_time': 1774714816.0, 'created_time': 1772655039.299709, 'last_price_update_time': 1774699793.445157}
2026-03-28 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HG91847') HTTP/1.1" 204 0
2026-03-28 12:09:53 [auto1.it] INFO: Found listing with ID: TM20698
2026-03-28 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TM20698%27 HTTP/1.1" 200 None
2026-03-28 12:09:53 [auto1.it] INFO: Scrape type for TM20698: 2
2026-03-28 12:09:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3947a3f9-f835-50b2-b829-a601d2a1c19b with identifier: TM20698
2026-03-28 12:09:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3947a3f9-f835-50b2-b829-a601d2a1c19b with scrape type 2
2026-03-28 12:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3947a3f9-f835-50b2-b829-a601d2a1c19b with scrape type 2
2026-03-28 12:09:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3947a3f9-f835-50b2-b829-a601d2a1c19b, identifier: TM20698
2026-03-28 12:09:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3947a3f9-f835-50b2-b829-a601d2a1c19b with identifier: TM20698
2026-03-28 12:09:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3947a3f9-f835-50b2-b829-a601d2a1c19b with identifier: TM20698
2026-03-28 12:09:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3947a3f9-f835-50b2-b829-a601d2a1c19b with identifier: TM20698 to the API
2026-03-28 12:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:25:07Z',
 'fuel_type': 'diesel',
 'id': '3947a3f9-f835-50b2-b829-a601d2a1c19b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM20698',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Talento',
 'odometer': 143798,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-20',
 'seller_name': None,
 'title': 'Fiat Talento 1.6 Turbodiesel Multijet L1H1 1,0t Basis',
 'transmission': 'manual',
 'trim': 'L1H1 1,0t Basis',
 'year': 2016}
2026-03-28 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TM20698%27 HTTP/1.1" 200 None
2026-03-28 12:09:53 [auto1.it] INFO: Saving data for TM20698: {'auction_closing_time': 1774715107.0, 'created_time': 1774613208.344565, 'last_price_update_time': 1774699793.819923}
2026-03-28 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TM20698') HTTP/1.1" 204 0
2026-03-28 12:09:53 [auto1.it] INFO: Found listing with ID: UP03227
2026-03-28 12:09:53 [auto1.it] INFO: Found listing with ID: KA22424
2026-03-28 12:09:53 [auto1.it] INFO: Found listing with ID: JW95602
2026-03-28 12:09:53 [auto1.it] INFO: Found listing with ID: FG41149
2026-03-28 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG41149%27 HTTP/1.1" 200 None
2026-03-28 12:09:53 [auto1.it] INFO: Scrape type for FG41149: 0
2026-03-28 12:09:53 [auto1.it] INFO: Found listing with ID: HA39708
2026-03-28 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA39708%27 HTTP/1.1" 200 None
2026-03-28 12:09:53 [auto1.it] INFO: Scrape type for HA39708: 2
2026-03-28 12:09:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2878974c-374b-5dfb-af10-05e12d183c51 with identifier: HA39708
2026-03-28 12:09:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2878974c-374b-5dfb-af10-05e12d183c51 with scrape type 2
2026-03-28 12:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2878974c-374b-5dfb-af10-05e12d183c51 with scrape type 2
2026-03-28 12:09:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2878974c-374b-5dfb-af10-05e12d183c51, identifier: HA39708
2026-03-28 12:09:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2878974c-374b-5dfb-af10-05e12d183c51 with identifier: HA39708
2026-03-28 12:09:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2878974c-374b-5dfb-af10-05e12d183c51 with identifier: HA39708
2026-03-28 12:09:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2878974c-374b-5dfb-af10-05e12d183c51 with identifier: HA39708 to the API
2026-03-28 12:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:25:30Z',
 'fuel_type': 'petrol',
 'id': '2878974c-374b-5dfb-af10-05e12d183c51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA39708',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 66168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-27',
 'seller_name': None,
 'title': 'Fiat Punto 1.2 Street',
 'transmission': 'manual',
 'trim': 'Street',
 'year': 2014}
2026-03-28 12:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA39708%27 HTTP/1.1" 200 None
2026-03-28 12:09:54 [auto1.it] INFO: Saving data for HA39708: {'auction_closing_time': 1774715130.0, 'created_time': 1774613135.384968, 'last_price_update_time': 1774699794.203576}
2026-03-28 12:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HA39708') HTTP/1.1" 204 0
2026-03-28 12:09:54 [auto1.it] INFO: Found listing with ID: FH51436
2026-03-28 12:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FH51436%27 HTTP/1.1" 200 None
2026-03-28 12:09:54 [auto1.it] INFO: Scrape type for FH51436: 2
2026-03-28 12:09:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9a41017-1a6d-5789-adc7-f9bed89469bf with identifier: FH51436
2026-03-28 12:09:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9a41017-1a6d-5789-adc7-f9bed89469bf with scrape type 2
2026-03-28 12:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9a41017-1a6d-5789-adc7-f9bed89469bf with scrape type 2
2026-03-28 12:09:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f9a41017-1a6d-5789-adc7-f9bed89469bf, identifier: FH51436
2026-03-28 12:09:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f9a41017-1a6d-5789-adc7-f9bed89469bf with identifier: FH51436
2026-03-28 12:09:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f9a41017-1a6d-5789-adc7-f9bed89469bf with identifier: FH51436
2026-03-28 12:09:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f9a41017-1a6d-5789-adc7-f9bed89469bf with identifier: FH51436 to the API
2026-03-28 12:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 400,
 'expiration_date': '2026-03-28T16:50:10Z',
 'fuel_type': 'petrol',
 'id': 'f9a41017-1a6d-5789-adc7-f9bed89469bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH51436',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'RS 3 Sportback',
 'odometer': 34374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-08',
 'seller_name': None,
 'title': 'Audi RS 3 Sportback 2.5 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2023}
2026-03-28 12:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FH51436%27 HTTP/1.1" 200 None
2026-03-28 12:09:54 [auto1.it] INFO: Saving data for FH51436: {'auction_closing_time': 1774716610.0, 'created_time': 1774613177.636077, 'last_price_update_time': 1774699794.604458}
2026-03-28 12:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FH51436') HTTP/1.1" 204 0
2026-03-28 12:09:54 [auto1.it] INFO: Found listing with ID: EH34312
2026-03-28 12:09:54 [auto1.it] INFO: Found listing with ID: AR14989
2026-03-28 12:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR14989%27 HTTP/1.1" 200 None
2026-03-28 12:09:54 [auto1.it] INFO: Scrape type for AR14989: 2
2026-03-28 12:09:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1552de29-41ce-5c37-82ff-676bb3c0d365 with identifier: AR14989
2026-03-28 12:09:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1552de29-41ce-5c37-82ff-676bb3c0d365 with scrape type 2
2026-03-28 12:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1552de29-41ce-5c37-82ff-676bb3c0d365 with scrape type 2
2026-03-28 12:09:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1552de29-41ce-5c37-82ff-676bb3c0d365, identifier: AR14989
2026-03-28 12:09:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1552de29-41ce-5c37-82ff-676bb3c0d365 with identifier: AR14989
2026-03-28 12:09:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1552de29-41ce-5c37-82ff-676bb3c0d365 with identifier: AR14989
2026-03-28 12:09:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1552de29-41ce-5c37-82ff-676bb3c0d365 with identifier: AR14989 to the API
2026-03-28 12:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:35:32Z',
 'fuel_type': 'petrol',
 'id': '1552de29-41ce-5c37-82ff-676bb3c0d365',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR14989',
 'listing': 'auction',
 'make': 'Abarth',
 'model': '595',
 'odometer': 41505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-15',
 'seller_name': None,
 'title': 'Abarth 595 1.4 Competizione',
 'transmission': 'manual',
 'trim': 'Competizione',
 'year': 2022}
2026-03-28 12:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR14989%27 HTTP/1.1" 200 None
2026-03-28 12:09:54 [auto1.it] INFO: Saving data for AR14989: {'auction_closing_time': 1774715732.0, 'created_time': 1774300010.709574, 'last_price_update_time': 1774699794.995055}
2026-03-28 12:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AR14989') HTTP/1.1" 204 0
2026-03-28 12:09:55 [auto1.it] INFO: Found listing with ID: YC82026
2026-03-28 12:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YC82026%27 HTTP/1.1" 200 None
2026-03-28 12:09:55 [auto1.it] INFO: Scrape type for YC82026: 2
2026-03-28 12:09:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32d023b7-d197-5a03-a132-46e82d9f0b3c with identifier: YC82026
2026-03-28 12:09:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32d023b7-d197-5a03-a132-46e82d9f0b3c with scrape type 2
2026-03-28 12:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32d023b7-d197-5a03-a132-46e82d9f0b3c with scrape type 2
2026-03-28 12:09:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 32d023b7-d197-5a03-a132-46e82d9f0b3c, identifier: YC82026
2026-03-28 12:09:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 32d023b7-d197-5a03-a132-46e82d9f0b3c with identifier: YC82026
2026-03-28 12:09:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 32d023b7-d197-5a03-a132-46e82d9f0b3c with identifier: YC82026
2026-03-28 12:09:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 32d023b7-d197-5a03-a132-46e82d9f0b3c with identifier: YC82026 to the API
2026-03-28 12:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-28T16:33:28Z',
 'fuel_type': 'diesel',
 'id': '32d023b7-d197-5a03-a132-46e82d9f0b3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC82026',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 195369,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-23',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic Sport',
 'transmission': 'automatic',
 'trim': '4Matic Sport',
 'year': 2020}
2026-03-28 12:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YC82026%27 HTTP/1.1" 200 None
2026-03-28 12:09:55 [auto1.it] INFO: Saving data for YC82026: {'auction_closing_time': 1774715608.0, 'created_time': 1774613184.660102, 'last_price_update_time': 1774699795.37481}
2026-03-28 12:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YC82026') HTTP/1.1" 204 0
2026-03-28 12:09:55 [auto1.it] INFO: Found listing with ID: XD81326
2026-03-28 12:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD81326%27 HTTP/1.1" 200 None
2026-03-28 12:09:55 [auto1.it] INFO: Scrape type for XD81326: 2
2026-03-28 12:09:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe138639-c88f-51e9-b1cf-1d89a808b0b9 with identifier: XD81326
2026-03-28 12:09:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe138639-c88f-51e9-b1cf-1d89a808b0b9 with scrape type 2
2026-03-28 12:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe138639-c88f-51e9-b1cf-1d89a808b0b9 with scrape type 2
2026-03-28 12:09:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fe138639-c88f-51e9-b1cf-1d89a808b0b9, identifier: XD81326
2026-03-28 12:09:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fe138639-c88f-51e9-b1cf-1d89a808b0b9 with identifier: XD81326
2026-03-28 12:09:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fe138639-c88f-51e9-b1cf-1d89a808b0b9 with identifier: XD81326
2026-03-28 12:09:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fe138639-c88f-51e9-b1cf-1d89a808b0b9 with identifier: XD81326 to the API
2026-03-28 12:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:58:02Z',
 'fuel_type': 'diesel',
 'id': 'fe138639-c88f-51e9-b1cf-1d89a808b0b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD81326',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5',
 'odometer': 257672,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-23',
 'seller_name': None,
 'title': 'Citroen C5 2.0 HDi Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2010}
2026-03-28 12:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD81326%27 HTTP/1.1" 200 None
2026-03-28 12:09:55 [auto1.it] INFO: Saving data for XD81326: {'auction_closing_time': 1774717082.0, 'created_time': 1774613137.857556, 'last_price_update_time': 1774699795.841349}
2026-03-28 12:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XD81326') HTTP/1.1" 204 0
2026-03-28 12:09:55 [auto1.it] INFO: Found listing with ID: JN59652
2026-03-28 12:09:55 [auto1.it] INFO: Found listing with ID: TJ64738
2026-03-28 12:09:55 [auto1.it] INFO: Found listing with ID: JK90392
2026-03-28 12:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK90392%27 HTTP/1.1" 200 None
2026-03-28 12:09:55 [auto1.it] INFO: Scrape type for JK90392: 2
2026-03-28 12:09:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 228b3ffd-e3e6-592b-b70f-55c65951d115 with identifier: JK90392
2026-03-28 12:09:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 228b3ffd-e3e6-592b-b70f-55c65951d115 with scrape type 2
2026-03-28 12:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 228b3ffd-e3e6-592b-b70f-55c65951d115 with scrape type 2
2026-03-28 12:09:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 228b3ffd-e3e6-592b-b70f-55c65951d115, identifier: JK90392
2026-03-28 12:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:09:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 228b3ffd-e3e6-592b-b70f-55c65951d115 with identifier: JK90392
2026-03-28 12:09:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 228b3ffd-e3e6-592b-b70f-55c65951d115 with identifier: JK90392
2026-03-28 12:09:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 228b3ffd-e3e6-592b-b70f-55c65951d115 with identifier: JK90392 to the API
2026-03-28 12:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:35:49Z',
 'fuel_type': 'diesel',
 'id': '228b3ffd-e3e6-592b-b70f-55c65951d115',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK90392',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6 Allroad',
 'odometer': 183116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-30',
 'seller_name': None,
 'title': 'Audi A6 Allroad 45 TDI Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-28 12:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK90392%27 HTTP/1.1" 200 None
2026-03-28 12:09:56 [auto1.it] INFO: Saving data for JK90392: {'auction_closing_time': 1774715749.0, 'created_time': 1774613209.077347, 'last_price_update_time': 1774699796.219841}
2026-03-28 12:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JK90392') HTTP/1.1" 204 0
2026-03-28 12:09:56 [auto1.it] INFO: Found listing with ID: JZ41811
2026-03-28 12:09:56 [auto1.it] INFO: Found listing with ID: AR28136
2026-03-28 12:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR28136%27 HTTP/1.1" 200 None
2026-03-28 12:09:56 [auto1.it] INFO: Scrape type for AR28136: 2
2026-03-28 12:09:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d850fe8-8f10-5483-b7f6-b316f70d4582 with identifier: AR28136
2026-03-28 12:09:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d850fe8-8f10-5483-b7f6-b316f70d4582 with scrape type 2
2026-03-28 12:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d850fe8-8f10-5483-b7f6-b316f70d4582 with scrape type 2
2026-03-28 12:09:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8d850fe8-8f10-5483-b7f6-b316f70d4582, identifier: AR28136
2026-03-28 12:09:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8d850fe8-8f10-5483-b7f6-b316f70d4582 with identifier: AR28136
2026-03-28 12:09:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8d850fe8-8f10-5483-b7f6-b316f70d4582 with identifier: AR28136
2026-03-28 12:09:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8d850fe8-8f10-5483-b7f6-b316f70d4582 with identifier: AR28136 to the API
2026-03-28 12:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:53:50Z',
 'fuel_type': 'petrol',
 'id': '8d850fe8-8f10-5483-b7f6-b316f70d4582',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR28136',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 98332,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-27',
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid Dolcevita',
 'transmission': 'manual',
 'trim': 'Dolcevita',
 'year': 2021}
2026-03-28 12:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR28136%27 HTTP/1.1" 200 None
2026-03-28 12:09:56 [auto1.it] INFO: Saving data for AR28136: {'auction_closing_time': 1774716830.0, 'created_time': 1774613174.249357, 'last_price_update_time': 1774699796.596102}
2026-03-28 12:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AR28136') HTTP/1.1" 204 0
2026-03-28 12:09:56 [auto1.it] INFO: Channel: 24h | Page: 72 | totalHits: 3675 | hits on page: 40
2026-03-28 12:09:56 [auto1.it] INFO: Found listing with ID: UA91591
2026-03-28 12:09:56 [auto1.it] INFO: Found listing with ID: FF45161
2026-03-28 12:09:56 [auto1.it] INFO: Found listing with ID: RZ15516
2026-03-28 12:09:56 [auto1.it] INFO: Found listing with ID: GN36205
2026-03-28 12:09:56 [auto1.it] INFO: Found listing with ID: LH69939
2026-03-28 12:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH69939%27 HTTP/1.1" 200 None
2026-03-28 12:09:56 [auto1.it] INFO: Scrape type for LH69939: 2
2026-03-28 12:09:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76daa2ad-5738-5376-a435-c56f2c3874a8 with identifier: LH69939
2026-03-28 12:09:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76daa2ad-5738-5376-a435-c56f2c3874a8 with scrape type 2
2026-03-28 12:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76daa2ad-5738-5376-a435-c56f2c3874a8 with scrape type 2
2026-03-28 12:09:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 76daa2ad-5738-5376-a435-c56f2c3874a8, identifier: LH69939
2026-03-28 12:09:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:09:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 76daa2ad-5738-5376-a435-c56f2c3874a8 with identifier: LH69939
2026-03-28 12:09:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 76daa2ad-5738-5376-a435-c56f2c3874a8 with identifier: LH69939
2026-03-28 12:09:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 76daa2ad-5738-5376-a435-c56f2c3874a8 with identifier: LH69939 to the API
2026-03-28 12:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:16:36Z',
 'fuel_type': 'diesel',
 'id': '76daa2ad-5738-5376-a435-c56f2c3874a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH69939',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 126241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-27',
 'seller_name': None,
 'title': 'MINI Clubman Cooper SD ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2018}
2026-03-28 12:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH69939%27 HTTP/1.1" 200 None
2026-03-28 12:09:57 [auto1.it] INFO: Saving data for LH69939: {'auction_closing_time': 1774714596.0, 'created_time': 1772102716.249911, 'last_price_update_time': 1774699797.617012}
2026-03-28 12:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LH69939') HTTP/1.1" 204 0
2026-03-28 12:09:57 [auto1.it] INFO: Found listing with ID: LM72883
2026-03-28 12:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM72883%27 HTTP/1.1" 200 None
2026-03-28 12:09:57 [auto1.it] INFO: Scrape type for LM72883: 2
2026-03-28 12:09:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d7eb1e2-89d0-5a6b-a87b-22b96c2ce546 with identifier: LM72883
2026-03-28 12:09:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d7eb1e2-89d0-5a6b-a87b-22b96c2ce546 with scrape type 2
2026-03-28 12:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d7eb1e2-89d0-5a6b-a87b-22b96c2ce546 with scrape type 2
2026-03-28 12:09:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1d7eb1e2-89d0-5a6b-a87b-22b96c2ce546, identifier: LM72883
2026-03-28 12:09:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1d7eb1e2-89d0-5a6b-a87b-22b96c2ce546 with identifier: LM72883
2026-03-28 12:09:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1d7eb1e2-89d0-5a6b-a87b-22b96c2ce546 with identifier: LM72883
2026-03-28 12:09:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1d7eb1e2-89d0-5a6b-a87b-22b96c2ce546 with identifier: LM72883 to the API
2026-03-28 12:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:31:47Z',
 'fuel_type': 'diesel',
 'id': '1d7eb1e2-89d0-5a6b-a87b-22b96c2ce546',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM72883',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 65532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-25',
 'seller_name': None,
 'title': 'Land Rover Evoque D165 Mild-Hybrid R-Dynamic SE',
 'transmission': 'automatic',
 'trim': 'R-Dynamic SE',
 'year': 2022}
2026-03-28 12:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM72883%27 HTTP/1.1" 200 None
2026-03-28 12:09:58 [auto1.it] INFO: Saving data for LM72883: {'auction_closing_time': 1774715507.0, 'created_time': 1773129523.359553, 'last_price_update_time': 1774699798.147846}
2026-03-28 12:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LM72883') HTTP/1.1" 204 0
2026-03-28 12:09:58 [auto1.it] INFO: Found listing with ID: KB99828
2026-03-28 12:09:58 [auto1.it] INFO: Found listing with ID: PA21374
2026-03-28 12:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA21374%27 HTTP/1.1" 200 None
2026-03-28 12:09:58 [auto1.it] INFO: Scrape type for PA21374: 0
2026-03-28 12:09:58 [auto1.it] INFO: Found listing with ID: LV04843
2026-03-28 12:09:58 [auto1.it] INFO: Found listing with ID: KP29994
2026-03-28 12:09:58 [auto1.it] INFO: Found listing with ID: BV21704
2026-03-28 12:09:58 [auto1.it] INFO: Found listing with ID: ZC10752
2026-03-28 12:09:58 [auto1.it] INFO: Found listing with ID: BR63865
2026-03-28 12:09:58 [auto1.it] INFO: Found listing with ID: DB81041
2026-03-28 12:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB81041%27 HTTP/1.1" 200 None
2026-03-28 12:09:58 [auto1.it] INFO: Scrape type for DB81041: 2
2026-03-28 12:09:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1b70468-9977-5172-aac9-cd8fb77a4ad1 with identifier: DB81041
2026-03-28 12:09:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1b70468-9977-5172-aac9-cd8fb77a4ad1 with scrape type 2
2026-03-28 12:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1b70468-9977-5172-aac9-cd8fb77a4ad1 with scrape type 2
2026-03-28 12:09:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b1b70468-9977-5172-aac9-cd8fb77a4ad1, identifier: DB81041
2026-03-28 12:09:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b1b70468-9977-5172-aac9-cd8fb77a4ad1 with identifier: DB81041
2026-03-28 12:09:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b1b70468-9977-5172-aac9-cd8fb77a4ad1 with identifier: DB81041
2026-03-28 12:09:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b1b70468-9977-5172-aac9-cd8fb77a4ad1 with identifier: DB81041 to the API
2026-03-28 12:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-28T16:47:18Z',
 'fuel_type': 'gas',
 'id': 'b1b70468-9977-5172-aac9-cd8fb77a4ad1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB81041',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Musa',
 'odometer': 152618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-23',
 'seller_name': None,
 'title': 'Lancia Musa 1.4 GPL Oro',
 'transmission': 'manual',
 'trim': 'Oro',
 'year': 2009}
2026-03-28 12:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB81041%27 HTTP/1.1" 200 None
2026-03-28 12:09:58 [auto1.it] INFO: Saving data for DB81041: {'auction_closing_time': 1774716438.0, 'created_time': 1774613140.870636, 'last_price_update_time': 1774699798.546793}
2026-03-28 12:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DB81041') HTTP/1.1" 204 0
2026-03-28 12:09:58 [auto1.it] INFO: Found listing with ID: BM64259
2026-03-28 12:09:58 [auto1.it] INFO: Found listing with ID: AJ89778
2026-03-28 12:09:58 [auto1.it] INFO: Found listing with ID: LX11958
2026-03-28 12:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX11958%27 HTTP/1.1" 200 None
2026-03-28 12:09:58 [auto1.it] INFO: Scrape type for LX11958: 2
2026-03-28 12:09:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5926f38-8f5a-5c22-863e-d63be29e2467 with identifier: LX11958
2026-03-28 12:09:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5926f38-8f5a-5c22-863e-d63be29e2467 with scrape type 2
2026-03-28 12:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5926f38-8f5a-5c22-863e-d63be29e2467 with scrape type 2
2026-03-28 12:09:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f5926f38-8f5a-5c22-863e-d63be29e2467, identifier: LX11958
2026-03-28 12:09:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f5926f38-8f5a-5c22-863e-d63be29e2467 with identifier: LX11958
2026-03-28 12:09:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f5926f38-8f5a-5c22-863e-d63be29e2467 with identifier: LX11958
2026-03-28 12:09:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f5926f38-8f5a-5c22-863e-d63be29e2467 with identifier: LX11958 to the API
2026-03-28 12:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:53:10Z',
 'fuel_type': 'diesel',
 'id': 'f5926f38-8f5a-5c22-863e-d63be29e2467',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX11958',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 147549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-29',
 'seller_name': None,
 'title': 'BMW 1er 118d Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2015}
2026-03-28 12:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX11958%27 HTTP/1.1" 200 None
2026-03-28 12:09:58 [auto1.it] INFO: Saving data for LX11958: {'auction_closing_time': 1774716790.0, 'created_time': 1772574730.82943, 'last_price_update_time': 1774699798.950767}
2026-03-28 12:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LX11958') HTTP/1.1" 204 0
2026-03-28 12:09:59 [auto1.it] INFO: Found listing with ID: CH57446
2026-03-28 12:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH57446%27 HTTP/1.1" 200 None
2026-03-28 12:09:59 [auto1.it] INFO: Scrape type for CH57446: 2
2026-03-28 12:09:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b3deaf2-4406-57e4-a11b-b9f0aa801f55 with identifier: CH57446
2026-03-28 12:09:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b3deaf2-4406-57e4-a11b-b9f0aa801f55 with scrape type 2
2026-03-28 12:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b3deaf2-4406-57e4-a11b-b9f0aa801f55 with scrape type 2
2026-03-28 12:09:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9b3deaf2-4406-57e4-a11b-b9f0aa801f55, identifier: CH57446
2026-03-28 12:09:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9b3deaf2-4406-57e4-a11b-b9f0aa801f55 with identifier: CH57446
2026-03-28 12:09:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9b3deaf2-4406-57e4-a11b-b9f0aa801f55 with identifier: CH57446
2026-03-28 12:09:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9b3deaf2-4406-57e4-a11b-b9f0aa801f55 with identifier: CH57446 to the API
2026-03-28 12:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-28T16:54:06Z',
 'fuel_type': 'gas',
 'id': '9b3deaf2-4406-57e4-a11b-b9f0aa801f55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH57446',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Grande Punto',
 'odometer': 257750,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-20',
 'seller_name': None,
 'title': 'Fiat Grande Punto 1.4 EasyPower',
 'transmission': 'manual',
 'trim': 'EasyPower',
 'year': 2012}
2026-03-28 12:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH57446%27 HTTP/1.1" 200 None
2026-03-28 12:09:59 [auto1.it] INFO: Saving data for CH57446: {'auction_closing_time': 1774716846.0, 'created_time': 1774613136.237964, 'last_price_update_time': 1774699799.414431}
2026-03-28 12:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CH57446') HTTP/1.1" 204 0
2026-03-28 12:09:59 [auto1.it] INFO: Found listing with ID: AR03634
2026-03-28 12:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR03634%27 HTTP/1.1" 200 None
2026-03-28 12:09:59 [auto1.it] INFO: Scrape type for AR03634: 2
2026-03-28 12:09:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f731d7e4-a7de-56db-8105-810b6f319b25 with identifier: AR03634
2026-03-28 12:09:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f731d7e4-a7de-56db-8105-810b6f319b25 with scrape type 2
2026-03-28 12:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f731d7e4-a7de-56db-8105-810b6f319b25 with scrape type 2
2026-03-28 12:09:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f731d7e4-a7de-56db-8105-810b6f319b25, identifier: AR03634
2026-03-28 12:09:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f731d7e4-a7de-56db-8105-810b6f319b25 with identifier: AR03634
2026-03-28 12:09:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f731d7e4-a7de-56db-8105-810b6f319b25 with identifier: AR03634
2026-03-28 12:09:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f731d7e4-a7de-56db-8105-810b6f319b25 with identifier: AR03634 to the API
2026-03-28 12:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:09:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:09:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:00:07Z',
 'fuel_type': 'diesel',
 'id': 'f731d7e4-a7de-56db-8105-810b6f319b25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR03634',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 45629,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-28',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 12:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR03634%27 HTTP/1.1" 200 None
2026-03-28 12:09:59 [auto1.it] INFO: Saving data for AR03634: {'auction_closing_time': 1774713607.0, 'created_time': 1773131076.154268, 'last_price_update_time': 1774699799.802017}
2026-03-28 12:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AR03634') HTTP/1.1" 204 0
2026-03-28 12:09:59 [auto1.it] INFO: Found listing with ID: GB22303
2026-03-28 12:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GB22303%27 HTTP/1.1" 200 None
2026-03-28 12:09:59 [auto1.it] INFO: Scrape type for GB22303: 2
2026-03-28 12:09:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aae010c3-65b3-5e4b-802f-4f55a9c79472 with identifier: GB22303
2026-03-28 12:09:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aae010c3-65b3-5e4b-802f-4f55a9c79472 with scrape type 2
2026-03-28 12:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aae010c3-65b3-5e4b-802f-4f55a9c79472 with scrape type 2
2026-03-28 12:09:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: aae010c3-65b3-5e4b-802f-4f55a9c79472, identifier: GB22303
2026-03-28 12:09:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: aae010c3-65b3-5e4b-802f-4f55a9c79472 with identifier: GB22303
2026-03-28 12:09:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: aae010c3-65b3-5e4b-802f-4f55a9c79472 with identifier: GB22303
2026-03-28 12:10:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: aae010c3-65b3-5e4b-802f-4f55a9c79472 with identifier: GB22303 to the API
2026-03-28 12:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-28T16:48:03Z',
 'fuel_type': 'petrol',
 'id': 'aae010c3-65b3-5e4b-802f-4f55a9c79472',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB22303',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto Evo',
 'odometer': 212077,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-23',
 'seller_name': None,
 'title': 'Fiat Punto Evo 1.4 MyLife',
 'transmission': 'manual',
 'trim': 'MyLife',
 'year': 2011}
2026-03-28 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GB22303%27 HTTP/1.1" 200 None
2026-03-28 12:10:00 [auto1.it] INFO: Saving data for GB22303: {'auction_closing_time': 1774716483.0, 'created_time': 1774613169.441367, 'last_price_update_time': 1774699800.255139}
2026-03-28 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GB22303') HTTP/1.1" 204 0
2026-03-28 12:10:00 [auto1.it] INFO: Found listing with ID: PT53216
2026-03-28 12:10:00 [auto1.it] INFO: Found listing with ID: XX29767
2026-03-28 12:10:00 [auto1.it] INFO: Found listing with ID: SV71044
2026-03-28 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV71044%27 HTTP/1.1" 200 None
2026-03-28 12:10:00 [auto1.it] INFO: Scrape type for SV71044: 2
2026-03-28 12:10:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b5af649-8e4d-5d99-acb5-777ff56e1e6f with identifier: SV71044
2026-03-28 12:10:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b5af649-8e4d-5d99-acb5-777ff56e1e6f with scrape type 2
2026-03-28 12:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b5af649-8e4d-5d99-acb5-777ff56e1e6f with scrape type 2
2026-03-28 12:10:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2b5af649-8e4d-5d99-acb5-777ff56e1e6f, identifier: SV71044
2026-03-28 12:10:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2b5af649-8e4d-5d99-acb5-777ff56e1e6f with identifier: SV71044
2026-03-28 12:10:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2b5af649-8e4d-5d99-acb5-777ff56e1e6f with identifier: SV71044
2026-03-28 12:10:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2b5af649-8e4d-5d99-acb5-777ff56e1e6f with identifier: SV71044 to the API
2026-03-28 12:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:42:37Z',
 'fuel_type': 'petrol',
 'id': '2b5af649-8e4d-5d99-acb5-777ff56e1e6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV71044',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'B-Max',
 'odometer': 163252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-14',
 'seller_name': None,
 'title': 'Ford B-Max 1.4 Plus',
 'transmission': 'manual',
 'trim': 'Plus',
 'year': 2016}
2026-03-28 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV71044%27 HTTP/1.1" 200 None
2026-03-28 12:10:00 [auto1.it] INFO: Saving data for SV71044: {'auction_closing_time': 1774716157.0, 'created_time': 1774613171.39368, 'last_price_update_time': 1774699800.67012}
2026-03-28 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SV71044') HTTP/1.1" 204 0
2026-03-28 12:10:00 [auto1.it] INFO: Found listing with ID: EP62214
2026-03-28 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP62214%27 HTTP/1.1" 200 None
2026-03-28 12:10:00 [auto1.it] INFO: Scrape type for EP62214: 2
2026-03-28 12:10:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2609e286-fb69-5cde-ae3b-5562ebbfc0e8 with identifier: EP62214
2026-03-28 12:10:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2609e286-fb69-5cde-ae3b-5562ebbfc0e8 with scrape type 2
2026-03-28 12:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2609e286-fb69-5cde-ae3b-5562ebbfc0e8 with scrape type 2
2026-03-28 12:10:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2609e286-fb69-5cde-ae3b-5562ebbfc0e8, identifier: EP62214
2026-03-28 12:10:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2609e286-fb69-5cde-ae3b-5562ebbfc0e8 with identifier: EP62214
2026-03-28 12:10:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2609e286-fb69-5cde-ae3b-5562ebbfc0e8 with identifier: EP62214
2026-03-28 12:10:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2609e286-fb69-5cde-ae3b-5562ebbfc0e8 with identifier: EP62214 to the API
2026-03-28 12:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:21:52Z',
 'fuel_type': 'petrol',
 'id': '2609e286-fb69-5cde-ae3b-5562ebbfc0e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP62214',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 77045,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-24',
 'seller_name': None,
 'title': 'Ford Fiesta 1.5 EcoBoost ST',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2019}
2026-03-28 12:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP62214%27 HTTP/1.1" 200 None
2026-03-28 12:10:01 [auto1.it] INFO: Saving data for EP62214: {'auction_closing_time': 1774714912.0, 'created_time': 1774613145.436962, 'last_price_update_time': 1774699801.041191}
2026-03-28 12:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EP62214') HTTP/1.1" 204 0
2026-03-28 12:10:01 [auto1.it] INFO: Found listing with ID: WW47132
2026-03-28 12:10:01 [auto1.it] INFO: Found listing with ID: BR31613
2026-03-28 12:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR31613%27 HTTP/1.1" 200 None
2026-03-28 12:10:01 [auto1.it] INFO: Scrape type for BR31613: 2
2026-03-28 12:10:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e8ef83f-fa7d-55f1-b755-addb763098e5 with identifier: BR31613
2026-03-28 12:10:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e8ef83f-fa7d-55f1-b755-addb763098e5 with scrape type 2
2026-03-28 12:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e8ef83f-fa7d-55f1-b755-addb763098e5 with scrape type 2
2026-03-28 12:10:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6e8ef83f-fa7d-55f1-b755-addb763098e5, identifier: BR31613
2026-03-28 12:10:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6e8ef83f-fa7d-55f1-b755-addb763098e5 with identifier: BR31613
2026-03-28 12:10:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6e8ef83f-fa7d-55f1-b755-addb763098e5 with identifier: BR31613
2026-03-28 12:10:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6e8ef83f-fa7d-55f1-b755-addb763098e5 with identifier: BR31613 to the API
2026-03-28 12:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-28T16:50:16Z',
 'fuel_type': 'diesel',
 'id': '6e8ef83f-fa7d-55f1-b755-addb763098e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR31613',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 74530,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-30',
 'seller_name': None,
 'title': 'BMW X3 xDrive 30d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-28 12:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR31613%27 HTTP/1.1" 200 None
2026-03-28 12:10:01 [auto1.it] INFO: Saving data for BR31613: {'auction_closing_time': 1774716616.0, 'created_time': 1772141267.60814, 'last_price_update_time': 1774699801.442942}
2026-03-28 12:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BR31613') HTTP/1.1" 204 0
2026-03-28 12:10:01 [auto1.it] INFO: Found listing with ID: SG91000
2026-03-28 12:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG91000%27 HTTP/1.1" 200 None
2026-03-28 12:10:01 [auto1.it] INFO: Scrape type for SG91000: 2
2026-03-28 12:10:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b490bb16-a1e2-5881-a125-80b8ee7c84fa with identifier: SG91000
2026-03-28 12:10:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b490bb16-a1e2-5881-a125-80b8ee7c84fa with scrape type 2
2026-03-28 12:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b490bb16-a1e2-5881-a125-80b8ee7c84fa with scrape type 2
2026-03-28 12:10:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b490bb16-a1e2-5881-a125-80b8ee7c84fa, identifier: SG91000
2026-03-28 12:10:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b490bb16-a1e2-5881-a125-80b8ee7c84fa with identifier: SG91000
2026-03-28 12:10:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b490bb16-a1e2-5881-a125-80b8ee7c84fa with identifier: SG91000
2026-03-28 12:10:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b490bb16-a1e2-5881-a125-80b8ee7c84fa with identifier: SG91000 to the API
2026-03-28 12:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:57:27Z',
 'fuel_type': 'petrol',
 'id': 'b490bb16-a1e2-5881-a125-80b8ee7c84fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG91000',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'NV200 Evalia',
 'odometer': 178292,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-22',
 'seller_name': None,
 'title': 'Nissan NV200 Evalia 1.6 Evalia Acenta',
 'transmission': 'manual',
 'trim': 'Evalia Acenta',
 'year': 2013}
2026-03-28 12:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG91000%27 HTTP/1.1" 200 None
2026-03-28 12:10:01 [auto1.it] INFO: Saving data for SG91000: {'auction_closing_time': 1774717047.0, 'created_time': 1774613177.998976, 'last_price_update_time': 1774699801.812994}
2026-03-28 12:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SG91000') HTTP/1.1" 204 0
2026-03-28 12:10:01 [auto1.it] INFO: Found listing with ID: SV61491
2026-03-28 12:10:01 [auto1.it] INFO: Found listing with ID: VF92770
2026-03-28 12:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF92770%27 HTTP/1.1" 200 None
2026-03-28 12:10:01 [auto1.it] INFO: Scrape type for VF92770: 2
2026-03-28 12:10:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9adddd04-0f4a-5f08-a8ff-e26b357e13ca with identifier: VF92770
2026-03-28 12:10:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9adddd04-0f4a-5f08-a8ff-e26b357e13ca with scrape type 2
2026-03-28 12:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9adddd04-0f4a-5f08-a8ff-e26b357e13ca with scrape type 2
2026-03-28 12:10:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9adddd04-0f4a-5f08-a8ff-e26b357e13ca, identifier: VF92770
2026-03-28 12:10:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9adddd04-0f4a-5f08-a8ff-e26b357e13ca with identifier: VF92770
2026-03-28 12:10:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9adddd04-0f4a-5f08-a8ff-e26b357e13ca with identifier: VF92770
2026-03-28 12:10:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9adddd04-0f4a-5f08-a8ff-e26b357e13ca with identifier: VF92770 to the API
2026-03-28 12:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:52:21Z',
 'fuel_type': 'diesel',
 'id': '9adddd04-0f4a-5f08-a8ff-e26b357e13ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF92770',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 237406,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-28',
 'seller_name': None,
 'title': 'BMW 5er 520d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-28 12:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF92770%27 HTTP/1.1" 200 None
2026-03-28 12:10:02 [auto1.it] INFO: Saving data for VF92770: {'auction_closing_time': 1774716741.0, 'created_time': 1774613202.135658, 'last_price_update_time': 1774699802.196732}
2026-03-28 12:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VF92770') HTTP/1.1" 204 0
2026-03-28 12:10:02 [auto1.it] INFO: Found listing with ID: AD83412
2026-03-28 12:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD83412%27 HTTP/1.1" 200 None
2026-03-28 12:10:02 [auto1.it] INFO: Scrape type for AD83412: 2
2026-03-28 12:10:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 385a11c0-a6f9-5ed6-bf51-b24f46397bb0 with identifier: AD83412
2026-03-28 12:10:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 385a11c0-a6f9-5ed6-bf51-b24f46397bb0 with scrape type 2
2026-03-28 12:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 385a11c0-a6f9-5ed6-bf51-b24f46397bb0 with scrape type 2
2026-03-28 12:10:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 385a11c0-a6f9-5ed6-bf51-b24f46397bb0, identifier: AD83412
2026-03-28 12:10:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 385a11c0-a6f9-5ed6-bf51-b24f46397bb0 with identifier: AD83412
2026-03-28 12:10:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 385a11c0-a6f9-5ed6-bf51-b24f46397bb0 with identifier: AD83412
2026-03-28 12:10:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 385a11c0-a6f9-5ed6-bf51-b24f46397bb0 with identifier: AD83412 to the API
2026-03-28 12:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:06:51Z',
 'fuel_type': 'diesel',
 'id': '385a11c0-a6f9-5ed6-bf51-b24f46397bb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD83412',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 181332,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-31',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 dCi N-Connecta',
 'transmission': 'automatic',
 'trim': 'N-Connecta',
 'year': 2019}
2026-03-28 12:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD83412%27 HTTP/1.1" 200 None
2026-03-28 12:10:02 [auto1.it] INFO: Saving data for AD83412: {'auction_closing_time': 1774714011.0, 'created_time': 1772308850.239889, 'last_price_update_time': 1774699802.694119}
2026-03-28 12:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AD83412') HTTP/1.1" 204 0
2026-03-28 12:10:02 [auto1.it] INFO: Found listing with ID: RF93024
2026-03-28 12:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF93024%27 HTTP/1.1" 200 None
2026-03-28 12:10:02 [auto1.it] INFO: Scrape type for RF93024: 2
2026-03-28 12:10:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75a76444-0fb4-54ab-8a98-5b050e5aa770 with identifier: RF93024
2026-03-28 12:10:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75a76444-0fb4-54ab-8a98-5b050e5aa770 with scrape type 2
2026-03-28 12:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75a76444-0fb4-54ab-8a98-5b050e5aa770 with scrape type 2
2026-03-28 12:10:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 75a76444-0fb4-54ab-8a98-5b050e5aa770, identifier: RF93024
2026-03-28 12:10:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 75a76444-0fb4-54ab-8a98-5b050e5aa770 with identifier: RF93024
2026-03-28 12:10:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 75a76444-0fb4-54ab-8a98-5b050e5aa770 with identifier: RF93024
2026-03-28 12:10:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 75a76444-0fb4-54ab-8a98-5b050e5aa770 with identifier: RF93024 to the API
2026-03-28 12:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:08:07Z',
 'fuel_type': 'petrol',
 'id': '75a76444-0fb4-54ab-8a98-5b050e5aa770',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF93024',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 103930,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-27',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Turbo Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2011}
2026-03-28 12:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF93024%27 HTTP/1.1" 200 None
2026-03-28 12:10:03 [auto1.it] INFO: Saving data for RF93024: {'auction_closing_time': 1774714087.0, 'created_time': 1774613182.008945, 'last_price_update_time': 1774699803.083419}
2026-03-28 12:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RF93024') HTTP/1.1" 204 0
2026-03-28 12:10:03 [auto1.it] INFO: Found listing with ID: PW70389
2026-03-28 12:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW70389%27 HTTP/1.1" 200 None
2026-03-28 12:10:03 [auto1.it] INFO: Scrape type for PW70389: 2
2026-03-28 12:10:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f06d1f89-d4a6-56fd-81a4-83dfc34eb222 with identifier: PW70389
2026-03-28 12:10:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f06d1f89-d4a6-56fd-81a4-83dfc34eb222 with scrape type 2
2026-03-28 12:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f06d1f89-d4a6-56fd-81a4-83dfc34eb222 with scrape type 2
2026-03-28 12:10:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f06d1f89-d4a6-56fd-81a4-83dfc34eb222, identifier: PW70389
2026-03-28 12:10:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f06d1f89-d4a6-56fd-81a4-83dfc34eb222 with identifier: PW70389
2026-03-28 12:10:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f06d1f89-d4a6-56fd-81a4-83dfc34eb222 with identifier: PW70389
2026-03-28 12:10:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f06d1f89-d4a6-56fd-81a4-83dfc34eb222 with identifier: PW70389 to the API
2026-03-28 12:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:50:35Z',
 'fuel_type': 'diesel',
 'id': 'f06d1f89-d4a6-56fd-81a4-83dfc34eb222',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW70389',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 185536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-18',
 'seller_name': None,
 'title': 'Fiat 500L 1.3 M-Jet Trekking',
 'transmission': 'manual',
 'trim': 'Trekking',
 'year': 2017}
2026-03-28 12:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW70389%27 HTTP/1.1" 200 None
2026-03-28 12:10:03 [auto1.it] INFO: Saving data for PW70389: {'auction_closing_time': 1774716635.0, 'created_time': 1774613295.358917, 'last_price_update_time': 1774699803.46215}
2026-03-28 12:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PW70389') HTTP/1.1" 204 0
2026-03-28 12:10:03 [auto1.it] INFO: Found listing with ID: YD99116
2026-03-28 12:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD99116%27 HTTP/1.1" 200 None
2026-03-28 12:10:03 [auto1.it] INFO: Scrape type for YD99116: 2
2026-03-28 12:10:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f82383d-0130-5d26-a9c8-38f3113cc8eb with identifier: YD99116
2026-03-28 12:10:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f82383d-0130-5d26-a9c8-38f3113cc8eb with scrape type 2
2026-03-28 12:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f82383d-0130-5d26-a9c8-38f3113cc8eb with scrape type 2
2026-03-28 12:10:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3f82383d-0130-5d26-a9c8-38f3113cc8eb, identifier: YD99116
2026-03-28 12:10:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3f82383d-0130-5d26-a9c8-38f3113cc8eb with identifier: YD99116
2026-03-28 12:10:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3f82383d-0130-5d26-a9c8-38f3113cc8eb with identifier: YD99116
2026-03-28 12:10:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3f82383d-0130-5d26-a9c8-38f3113cc8eb with identifier: YD99116 to the API
2026-03-28 12:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:59:09Z',
 'fuel_type': 'diesel',
 'id': '3f82383d-0130-5d26-a9c8-38f3113cc8eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD99116',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 125800,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-18',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport D150 S AWD',
 'transmission': 'automatic',
 'trim': 'S AWD',
 'year': 2020}
2026-03-28 12:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD99116%27 HTTP/1.1" 200 None
2026-03-28 12:10:03 [auto1.it] INFO: Saving data for YD99116: {'auction_closing_time': 1774717149.0, 'created_time': 1774613290.929232, 'last_price_update_time': 1774699803.8399}
2026-03-28 12:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YD99116') HTTP/1.1" 204 0
2026-03-28 12:10:03 [auto1.it] INFO: Found listing with ID: HF24893
2026-03-28 12:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF24893%27 HTTP/1.1" 200 None
2026-03-28 12:10:03 [auto1.it] INFO: Scrape type for HF24893: 0
2026-03-28 12:10:03 [auto1.it] INFO: Found listing with ID: WP29588
2026-03-28 12:10:03 [auto1.it] INFO: Found listing with ID: VE26782
2026-03-28 12:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VE26782%27 HTTP/1.1" 200 None
2026-03-28 12:10:03 [auto1.it] INFO: Scrape type for VE26782: 2
2026-03-28 12:10:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 241b1c1e-b55d-5937-a19a-efa3cf9dba60 with identifier: VE26782
2026-03-28 12:10:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 241b1c1e-b55d-5937-a19a-efa3cf9dba60 with scrape type 2
2026-03-28 12:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 241b1c1e-b55d-5937-a19a-efa3cf9dba60 with scrape type 2
2026-03-28 12:10:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 241b1c1e-b55d-5937-a19a-efa3cf9dba60, identifier: VE26782
2026-03-28 12:10:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 241b1c1e-b55d-5937-a19a-efa3cf9dba60 with identifier: VE26782
2026-03-28 12:10:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 241b1c1e-b55d-5937-a19a-efa3cf9dba60 with identifier: VE26782
2026-03-28 12:10:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 241b1c1e-b55d-5937-a19a-efa3cf9dba60 with identifier: VE26782 to the API
2026-03-28 12:10:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:22:09Z',
 'fuel_type': 'diesel',
 'id': '241b1c1e-b55d-5937-a19a-efa3cf9dba60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE26782',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 195522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-28',
 'seller_name': None,
 'title': 'BMW 1er 118d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2016}
2026-03-28 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VE26782%27 HTTP/1.1" 200 None
2026-03-28 12:10:04 [auto1.it] INFO: Saving data for VE26782: {'auction_closing_time': 1774714929.0, 'created_time': 1774613289.337664, 'last_price_update_time': 1774699804.236634}
2026-03-28 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VE26782') HTTP/1.1" 204 0
2026-03-28 12:10:04 [auto1.it] INFO: Found listing with ID: WL14524
2026-03-28 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL14524%27 HTTP/1.1" 200 None
2026-03-28 12:10:04 [auto1.it] INFO: Scrape type for WL14524: 2
2026-03-28 12:10:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3decb465-a253-5c06-ad0d-31bdc18f2b1d with identifier: WL14524
2026-03-28 12:10:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3decb465-a253-5c06-ad0d-31bdc18f2b1d with scrape type 2
2026-03-28 12:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3decb465-a253-5c06-ad0d-31bdc18f2b1d with scrape type 2
2026-03-28 12:10:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3decb465-a253-5c06-ad0d-31bdc18f2b1d, identifier: WL14524
2026-03-28 12:10:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3decb465-a253-5c06-ad0d-31bdc18f2b1d with identifier: WL14524
2026-03-28 12:10:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3decb465-a253-5c06-ad0d-31bdc18f2b1d with identifier: WL14524
2026-03-28 12:10:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3decb465-a253-5c06-ad0d-31bdc18f2b1d with identifier: WL14524 to the API
2026-03-28 12:10:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:24:20Z',
 'fuel_type': 'petrol',
 'id': '3decb465-a253-5c06-ad0d-31bdc18f2b1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL14524',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 60603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-30',
 'seller_name': None,
 'title': 'Fiat Doblo 1.4 Turbo Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2020}
2026-03-28 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL14524%27 HTTP/1.1" 200 None
2026-03-28 12:10:04 [auto1.it] INFO: Saving data for WL14524: {'auction_closing_time': 1774715060.0, 'created_time': 1774613305.985158, 'last_price_update_time': 1774699804.617755}
2026-03-28 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WL14524') HTTP/1.1" 204 0
2026-03-28 12:10:04 [auto1.it] INFO: Found listing with ID: PA28005
2026-03-28 12:10:04 [auto1.it] INFO: Found listing with ID: DN97608
2026-03-28 12:10:04 [auto1.it] INFO: Found listing with ID: JU37769
2026-03-28 12:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:05 [auto1.it] INFO: Channel: 24h | Page: 73 | totalHits: 3675 | hits on page: 40
2026-03-28 12:10:05 [auto1.it] INFO: Found listing with ID: EC29909
2026-03-28 12:10:05 [auto1.it] INFO: Found listing with ID: AU78491
2026-03-28 12:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU78491%27 HTTP/1.1" 200 None
2026-03-28 12:10:05 [auto1.it] INFO: Scrape type for AU78491: 0
2026-03-28 12:10:05 [auto1.it] INFO: Found listing with ID: HZ92978
2026-03-28 12:10:05 [auto1.it] INFO: Found listing with ID: HZ65981
2026-03-28 12:10:05 [auto1.it] INFO: Found listing with ID: RT39388
2026-03-28 12:10:05 [auto1.it] INFO: Found listing with ID: SR58570
2026-03-28 12:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR58570%27 HTTP/1.1" 200 None
2026-03-28 12:10:05 [auto1.it] INFO: Scrape type for SR58570: 2
2026-03-28 12:10:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09c17032-eea9-5759-ad51-0c00da25a4b3 with identifier: SR58570
2026-03-28 12:10:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09c17032-eea9-5759-ad51-0c00da25a4b3 with scrape type 2
2026-03-28 12:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09c17032-eea9-5759-ad51-0c00da25a4b3 with scrape type 2
2026-03-28 12:10:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 09c17032-eea9-5759-ad51-0c00da25a4b3, identifier: SR58570
2026-03-28 12:10:05 [scrapy.extensions.logstats] INFO: Crawled 269 pages (at 23 pages/min), scraped 223 items (at 42 items/min)
2026-03-28 12:10:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 200MiB
2026-03-28 12:10:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 09c17032-eea9-5759-ad51-0c00da25a4b3 with identifier: SR58570
2026-03-28 12:10:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 09c17032-eea9-5759-ad51-0c00da25a4b3 with identifier: SR58570
2026-03-28 12:10:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 09c17032-eea9-5759-ad51-0c00da25a4b3 with identifier: SR58570 to the API
2026-03-28 12:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:29:58Z',
 'fuel_type': 'diesel',
 'id': '09c17032-eea9-5759-ad51-0c00da25a4b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR58570',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 51635,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-18',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.4 TDI Metal',
 'transmission': 'automatic',
 'trim': 'Metal',
 'year': 2015}
2026-03-28 12:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR58570%27 HTTP/1.1" 200 None
2026-03-28 12:10:05 [auto1.it] INFO: Saving data for SR58570: {'auction_closing_time': 1774715398.0, 'created_time': 1774613224.299368, 'last_price_update_time': 1774699805.486056}
2026-03-28 12:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SR58570') HTTP/1.1" 204 0
2026-03-28 12:10:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:05 [auto1.it] INFO: Found listing with ID: GJ43112
2026-03-28 12:10:05 [auto1.it] INFO: Found listing with ID: PT96186
2026-03-28 12:10:05 [auto1.it] INFO: Found listing with ID: ZS94509
2026-03-28 12:10:05 [auto1.it] INFO: Found listing with ID: XF95831
2026-03-28 12:10:05 [auto1.it] INFO: Found listing with ID: HW38972
2026-03-28 12:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW38972%27 HTTP/1.1" 200 None
2026-03-28 12:10:05 [auto1.it] INFO: Scrape type for HW38972: 2
2026-03-28 12:10:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0fa6258-7534-5c8c-bb2b-eec172c16365 with identifier: HW38972
2026-03-28 12:10:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0fa6258-7534-5c8c-bb2b-eec172c16365 with scrape type 2
2026-03-28 12:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0fa6258-7534-5c8c-bb2b-eec172c16365 with scrape type 2
2026-03-28 12:10:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b0fa6258-7534-5c8c-bb2b-eec172c16365, identifier: HW38972
2026-03-28 12:10:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b0fa6258-7534-5c8c-bb2b-eec172c16365 with identifier: HW38972
2026-03-28 12:10:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b0fa6258-7534-5c8c-bb2b-eec172c16365 with identifier: HW38972
2026-03-28 12:10:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b0fa6258-7534-5c8c-bb2b-eec172c16365 with identifier: HW38972 to the API
2026-03-28 12:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:01:51Z',
 'fuel_type': 'diesel',
 'id': 'b0fa6258-7534-5c8c-bb2b-eec172c16365',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW38972',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 286352,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-13',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 12:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW38972%27 HTTP/1.1" 200 None
2026-03-28 12:10:06 [auto1.it] INFO: Saving data for HW38972: {'auction_closing_time': 1774713711.0, 'created_time': 1774613210.580625, 'last_price_update_time': 1774699806.060961}
2026-03-28 12:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HW38972') HTTP/1.1" 204 0
2026-03-28 12:10:06 [auto1.it] INFO: Found listing with ID: TX96321
2026-03-28 12:10:06 [auto1.it] INFO: Found listing with ID: YD44226
2026-03-28 12:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD44226%27 HTTP/1.1" 200 None
2026-03-28 12:10:06 [auto1.it] INFO: Scrape type for YD44226: 2
2026-03-28 12:10:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ead3da7-559c-535c-9945-10f509749b8c with identifier: YD44226
2026-03-28 12:10:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ead3da7-559c-535c-9945-10f509749b8c with scrape type 2
2026-03-28 12:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ead3da7-559c-535c-9945-10f509749b8c with scrape type 2
2026-03-28 12:10:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1ead3da7-559c-535c-9945-10f509749b8c, identifier: YD44226
2026-03-28 12:10:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1ead3da7-559c-535c-9945-10f509749b8c with identifier: YD44226
2026-03-28 12:10:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1ead3da7-559c-535c-9945-10f509749b8c with identifier: YD44226
2026-03-28 12:10:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1ead3da7-559c-535c-9945-10f509749b8c with identifier: YD44226 to the API
2026-03-28 12:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:11:35Z',
 'fuel_type': 'diesel',
 'id': '1ead3da7-559c-535c-9945-10f509749b8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD44226',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 177187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-05',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2015}
2026-03-28 12:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD44226%27 HTTP/1.1" 200 None
2026-03-28 12:10:06 [auto1.it] INFO: Saving data for YD44226: {'auction_closing_time': 1774714295.0, 'created_time': 1774613201.053153, 'last_price_update_time': 1774699806.448419}
2026-03-28 12:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YD44226') HTTP/1.1" 204 0
2026-03-28 12:10:06 [auto1.it] INFO: Found listing with ID: RX07844
2026-03-28 12:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX07844%27 HTTP/1.1" 200 None
2026-03-28 12:10:06 [auto1.it] INFO: Scrape type for RX07844: 2
2026-03-28 12:10:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3ba273a-dd96-5d72-8fc1-08f59684b216 with identifier: RX07844
2026-03-28 12:10:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3ba273a-dd96-5d72-8fc1-08f59684b216 with scrape type 2
2026-03-28 12:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3ba273a-dd96-5d72-8fc1-08f59684b216 with scrape type 2
2026-03-28 12:10:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e3ba273a-dd96-5d72-8fc1-08f59684b216, identifier: RX07844
2026-03-28 12:10:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e3ba273a-dd96-5d72-8fc1-08f59684b216 with identifier: RX07844
2026-03-28 12:10:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e3ba273a-dd96-5d72-8fc1-08f59684b216 with identifier: RX07844
2026-03-28 12:10:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e3ba273a-dd96-5d72-8fc1-08f59684b216 with identifier: RX07844 to the API
2026-03-28 12:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 249,
 'expiration_date': '2026-03-28T16:08:32Z',
 'fuel_type': 'petrol',
 'id': 'e3ba273a-dd96-5d72-8fc1-08f59684b216',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX07844',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 24424,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-12',
 'seller_name': None,
 'title': 'Land Rover Evoque P250 Mild-Hybrid R-dynamic S',
 'transmission': 'automatic',
 'trim': 'R-dynamic S',
 'year': 2022}
2026-03-28 12:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX07844%27 HTTP/1.1" 200 None
2026-03-28 12:10:06 [auto1.it] INFO: Saving data for RX07844: {'auction_closing_time': 1774714112.0, 'created_time': 1774613198.400735, 'last_price_update_time': 1774699806.845101}
2026-03-28 12:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RX07844') HTTP/1.1" 204 0
2026-03-28 12:10:06 [auto1.it] INFO: Found listing with ID: YS49191
2026-03-28 12:10:06 [auto1.it] INFO: Found listing with ID: EF98667
2026-03-28 12:10:06 [auto1.it] INFO: Found listing with ID: AR12639
2026-03-28 12:10:06 [auto1.it] INFO: Found listing with ID: XC85106
2026-03-28 12:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC85106%27 HTTP/1.1" 200 None
2026-03-28 12:10:06 [auto1.it] INFO: Scrape type for XC85106: 2
2026-03-28 12:10:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f4f7adc-5005-5660-8ea9-4537f3ff3848 with identifier: XC85106
2026-03-28 12:10:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f4f7adc-5005-5660-8ea9-4537f3ff3848 with scrape type 2
2026-03-28 12:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f4f7adc-5005-5660-8ea9-4537f3ff3848 with scrape type 2
2026-03-28 12:10:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9f4f7adc-5005-5660-8ea9-4537f3ff3848, identifier: XC85106
2026-03-28 12:10:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9f4f7adc-5005-5660-8ea9-4537f3ff3848 with identifier: XC85106
2026-03-28 12:10:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9f4f7adc-5005-5660-8ea9-4537f3ff3848 with identifier: XC85106
2026-03-28 12:10:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9f4f7adc-5005-5660-8ea9-4537f3ff3848 with identifier: XC85106 to the API
2026-03-28 12:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 280,
 'expiration_date': '2026-03-28T16:40:40Z',
 'fuel_type': 'petrol',
 'id': '9f4f7adc-5005-5660-8ea9-4537f3ff3848',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC85106',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 123295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-23',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.0 Turbo Super Q4',
 'transmission': 'automatic',
 'trim': 'Super Q4',
 'year': 2017}
2026-03-28 12:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC85106%27 HTTP/1.1" 200 None
2026-03-28 12:10:07 [auto1.it] INFO: Saving data for XC85106: {'auction_closing_time': 1774716040.0, 'created_time': 1774613170.647217, 'last_price_update_time': 1774699807.286354}
2026-03-28 12:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XC85106') HTTP/1.1" 204 0
2026-03-28 12:10:07 [auto1.it] INFO: Found listing with ID: GX81106
2026-03-28 12:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX81106%27 HTTP/1.1" 200 None
2026-03-28 12:10:07 [auto1.it] INFO: Scrape type for GX81106: 2
2026-03-28 12:10:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7b2387b-275b-5004-b38d-76ead9602e60 with identifier: GX81106
2026-03-28 12:10:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7b2387b-275b-5004-b38d-76ead9602e60 with scrape type 2
2026-03-28 12:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7b2387b-275b-5004-b38d-76ead9602e60 with scrape type 2
2026-03-28 12:10:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e7b2387b-275b-5004-b38d-76ead9602e60, identifier: GX81106
2026-03-28 12:10:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e7b2387b-275b-5004-b38d-76ead9602e60 with identifier: GX81106
2026-03-28 12:10:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e7b2387b-275b-5004-b38d-76ead9602e60 with identifier: GX81106
2026-03-28 12:10:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e7b2387b-275b-5004-b38d-76ead9602e60 with identifier: GX81106 to the API
2026-03-28 12:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:23:00Z',
 'fuel_type': 'diesel',
 'id': 'e7b2387b-275b-5004-b38d-76ead9602e60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX81106',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 163757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-15',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 CDI Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2017}
2026-03-28 12:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX81106%27 HTTP/1.1" 200 None
2026-03-28 12:10:07 [auto1.it] INFO: Saving data for GX81106: {'auction_closing_time': 1774714980.0, 'created_time': 1773135820.106648, 'last_price_update_time': 1774699807.784803}
2026-03-28 12:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GX81106') HTTP/1.1" 204 0
2026-03-28 12:10:07 [auto1.it] INFO: Found listing with ID: WM75200
2026-03-28 12:10:07 [auto1.it] INFO: Found listing with ID: WE98269
2026-03-28 12:10:07 [auto1.it] INFO: Found listing with ID: NH13553
2026-03-28 12:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH13553%27 HTTP/1.1" 200 None
2026-03-28 12:10:07 [auto1.it] INFO: Scrape type for NH13553: 2
2026-03-28 12:10:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7d3a820-347f-54f6-b62f-63503bd3dbec with identifier: NH13553
2026-03-28 12:10:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7d3a820-347f-54f6-b62f-63503bd3dbec with scrape type 2
2026-03-28 12:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7d3a820-347f-54f6-b62f-63503bd3dbec with scrape type 2
2026-03-28 12:10:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f7d3a820-347f-54f6-b62f-63503bd3dbec, identifier: NH13553
2026-03-28 12:10:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f7d3a820-347f-54f6-b62f-63503bd3dbec with identifier: NH13553
2026-03-28 12:10:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f7d3a820-347f-54f6-b62f-63503bd3dbec with identifier: NH13553
2026-03-28 12:10:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f7d3a820-347f-54f6-b62f-63503bd3dbec with identifier: NH13553 to the API
2026-03-28 12:10:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:29:01Z',
 'fuel_type': 'diesel',
 'id': 'f7d3a820-347f-54f6-b62f-63503bd3dbec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH13553',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 171586,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-23',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Business BlueMotion',
 'transmission': 'manual',
 'trim': 'Business BlueMotion',
 'year': 2019}
2026-03-28 12:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH13553%27 HTTP/1.1" 200 None
2026-03-28 12:10:08 [auto1.it] INFO: Saving data for NH13553: {'auction_closing_time': 1774715341.0, 'created_time': 1774613180.941683, 'last_price_update_time': 1774699808.168}
2026-03-28 12:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NH13553') HTTP/1.1" 204 0
2026-03-28 12:10:08 [auto1.it] INFO: Found listing with ID: CU15371
2026-03-28 12:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU15371%27 HTTP/1.1" 200 None
2026-03-28 12:10:08 [auto1.it] INFO: Scrape type for CU15371: 2
2026-03-28 12:10:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d93c3ed-efe3-5c38-9f52-3c51fd8154c8 with identifier: CU15371
2026-03-28 12:10:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d93c3ed-efe3-5c38-9f52-3c51fd8154c8 with scrape type 2
2026-03-28 12:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d93c3ed-efe3-5c38-9f52-3c51fd8154c8 with scrape type 2
2026-03-28 12:10:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1d93c3ed-efe3-5c38-9f52-3c51fd8154c8, identifier: CU15371
2026-03-28 12:10:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1d93c3ed-efe3-5c38-9f52-3c51fd8154c8 with identifier: CU15371
2026-03-28 12:10:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1d93c3ed-efe3-5c38-9f52-3c51fd8154c8 with identifier: CU15371
2026-03-28 12:10:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1d93c3ed-efe3-5c38-9f52-3c51fd8154c8 with identifier: CU15371 to the API
2026-03-28 12:10:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:58:24Z',
 'fuel_type': 'diesel',
 'id': '1d93c3ed-efe3-5c38-9f52-3c51fd8154c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU15371',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 127833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-27',
 'seller_name': None,
 'title': 'Jaguar E-Pace D150 S AWD',
 'transmission': 'automatic',
 'trim': 'S AWD',
 'year': 2019}
2026-03-28 12:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU15371%27 HTTP/1.1" 200 None
2026-03-28 12:10:08 [auto1.it] INFO: Saving data for CU15371: {'auction_closing_time': 1774717104.0, 'created_time': 1774613143.977544, 'last_price_update_time': 1774699808.568249}
2026-03-28 12:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CU15371') HTTP/1.1" 204 0
2026-03-28 12:10:08 [auto1.it] INFO: Found listing with ID: BN52557
2026-03-28 12:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN52557%27 HTTP/1.1" 200 None
2026-03-28 12:10:08 [auto1.it] INFO: Scrape type for BN52557: 2
2026-03-28 12:10:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 321dbf73-1360-57e7-8bd1-ca271555ff16 with identifier: BN52557
2026-03-28 12:10:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 321dbf73-1360-57e7-8bd1-ca271555ff16 with scrape type 2
2026-03-28 12:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 321dbf73-1360-57e7-8bd1-ca271555ff16 with scrape type 2
2026-03-28 12:10:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 321dbf73-1360-57e7-8bd1-ca271555ff16, identifier: BN52557
2026-03-28 12:10:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 321dbf73-1360-57e7-8bd1-ca271555ff16 with identifier: BN52557
2026-03-28 12:10:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 321dbf73-1360-57e7-8bd1-ca271555ff16 with identifier: BN52557
2026-03-28 12:10:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 321dbf73-1360-57e7-8bd1-ca271555ff16 with identifier: BN52557 to the API
2026-03-28 12:10:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:41:01Z',
 'fuel_type': 'diesel',
 'id': '321dbf73-1360-57e7-8bd1-ca271555ff16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN52557',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 169837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-22',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d 4Matic Business',
 'transmission': 'automatic',
 'trim': '4Matic Business',
 'year': 2017}
2026-03-28 12:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN52557%27 HTTP/1.1" 200 None
2026-03-28 12:10:09 [auto1.it] INFO: Saving data for BN52557: {'auction_closing_time': 1774716061.0, 'created_time': 1774613147.143572, 'last_price_update_time': 1774699809.013844}
2026-03-28 12:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BN52557') HTTP/1.1" 204 0
2026-03-28 12:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:09 [auto1.it] INFO: Found listing with ID: EA61163
2026-03-28 12:10:09 [auto1.it] INFO: Found listing with ID: PU90509
2026-03-28 12:10:09 [auto1.it] INFO: Found listing with ID: RB23819
2026-03-28 12:10:09 [auto1.it] INFO: Found listing with ID: HT95885
2026-03-28 12:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT95885%27 HTTP/1.1" 200 None
2026-03-28 12:10:09 [auto1.it] INFO: Scrape type for HT95885: 2
2026-03-28 12:10:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15037130-6d90-572c-95c3-ced2b2ac7de2 with identifier: HT95885
2026-03-28 12:10:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15037130-6d90-572c-95c3-ced2b2ac7de2 with scrape type 2
2026-03-28 12:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15037130-6d90-572c-95c3-ced2b2ac7de2 with scrape type 2
2026-03-28 12:10:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 15037130-6d90-572c-95c3-ced2b2ac7de2, identifier: HT95885
2026-03-28 12:10:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 15037130-6d90-572c-95c3-ced2b2ac7de2 with identifier: HT95885
2026-03-28 12:10:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 15037130-6d90-572c-95c3-ced2b2ac7de2 with identifier: HT95885
2026-03-28 12:10:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 15037130-6d90-572c-95c3-ced2b2ac7de2 with identifier: HT95885 to the API
2026-03-28 12:10:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:31:54Z',
 'fuel_type': 'diesel',
 'id': '15037130-6d90-572c-95c3-ced2b2ac7de2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT95885',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 152879,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-29',
 'seller_name': None,
 'title': 'BMW 1er 116d Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2017}
2026-03-28 12:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT95885%27 HTTP/1.1" 200 None
2026-03-28 12:10:09 [auto1.it] INFO: Saving data for HT95885: {'auction_closing_time': 1774715514.0, 'created_time': 1774613166.093815, 'last_price_update_time': 1774699809.425898}
2026-03-28 12:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HT95885') HTTP/1.1" 204 0
2026-03-28 12:10:09 [auto1.it] INFO: Found listing with ID: EA76192
2026-03-28 12:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA76192%27 HTTP/1.1" 200 None
2026-03-28 12:10:09 [auto1.it] INFO: Scrape type for EA76192: 2
2026-03-28 12:10:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8e9f9f8-1be2-5795-a91e-73e0dce174c5 with identifier: EA76192
2026-03-28 12:10:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8e9f9f8-1be2-5795-a91e-73e0dce174c5 with scrape type 2
2026-03-28 12:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8e9f9f8-1be2-5795-a91e-73e0dce174c5 with scrape type 2
2026-03-28 12:10:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d8e9f9f8-1be2-5795-a91e-73e0dce174c5, identifier: EA76192
2026-03-28 12:10:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d8e9f9f8-1be2-5795-a91e-73e0dce174c5 with identifier: EA76192
2026-03-28 12:10:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d8e9f9f8-1be2-5795-a91e-73e0dce174c5 with identifier: EA76192
2026-03-28 12:10:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d8e9f9f8-1be2-5795-a91e-73e0dce174c5 with identifier: EA76192 to the API
2026-03-28 12:10:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:19:45Z',
 'fuel_type': 'petrol',
 'id': 'd8e9f9f8-1be2-5795-a91e-73e0dce174c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA76192',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix20',
 'odometer': 203477,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-24',
 'seller_name': None,
 'title': 'Hyundai ix20 1.4 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2011}
2026-03-28 12:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA76192%27 HTTP/1.1" 200 None
2026-03-28 12:10:09 [auto1.it] INFO: Saving data for EA76192: {'auction_closing_time': 1774714785.0, 'created_time': 1774613168.257956, 'last_price_update_time': 1774699809.844546}
2026-03-28 12:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EA76192') HTTP/1.1" 204 0
2026-03-28 12:10:09 [auto1.it] INFO: Channel: 24h | Page: 74 | totalHits: 3675 | hits on page: 40
2026-03-28 12:10:09 [auto1.it] INFO: Found listing with ID: HK62879
2026-03-28 12:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK62879%27 HTTP/1.1" 200 None
2026-03-28 12:10:09 [auto1.it] INFO: Scrape type for HK62879: 2
2026-03-28 12:10:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a60db98-fa11-57e0-b9cb-8f38ee220974 with identifier: HK62879
2026-03-28 12:10:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a60db98-fa11-57e0-b9cb-8f38ee220974 with scrape type 2
2026-03-28 12:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a60db98-fa11-57e0-b9cb-8f38ee220974 with scrape type 2
2026-03-28 12:10:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7a60db98-fa11-57e0-b9cb-8f38ee220974, identifier: HK62879
2026-03-28 12:10:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7a60db98-fa11-57e0-b9cb-8f38ee220974 with identifier: HK62879
2026-03-28 12:10:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7a60db98-fa11-57e0-b9cb-8f38ee220974 with identifier: HK62879
2026-03-28 12:10:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7a60db98-fa11-57e0-b9cb-8f38ee220974 with identifier: HK62879 to the API
2026-03-28 12:10:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:41:59Z',
 'fuel_type': 'petrol',
 'id': '7a60db98-fa11-57e0-b9cb-8f38ee220974',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK62879',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 107625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1997-07-17',
 'seller_name': None,
 'title': 'Renault Megane 1.6 RN',
 'transmission': 'manual',
 'trim': 'RN',
 'year': 1997}
2026-03-28 12:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK62879%27 HTTP/1.1" 200 None
2026-03-28 12:10:10 [auto1.it] INFO: Saving data for HK62879: {'auction_closing_time': 1774716119.0, 'created_time': 1774613165.071522, 'last_price_update_time': 1774699810.31929}
2026-03-28 12:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HK62879') HTTP/1.1" 204 0
2026-03-28 12:10:10 [auto1.it] INFO: Found listing with ID: PX76093
2026-03-28 12:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PX76093%27 HTTP/1.1" 200 None
2026-03-28 12:10:10 [auto1.it] INFO: Scrape type for PX76093: 2
2026-03-28 12:10:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 648eb12d-9809-5171-977a-61b880c9ccc2 with identifier: PX76093
2026-03-28 12:10:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 648eb12d-9809-5171-977a-61b880c9ccc2 with scrape type 2
2026-03-28 12:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 648eb12d-9809-5171-977a-61b880c9ccc2 with scrape type 2
2026-03-28 12:10:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 648eb12d-9809-5171-977a-61b880c9ccc2, identifier: PX76093
2026-03-28 12:10:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:10 [auto1.it] INFO: Found listing with ID: UW31013
2026-03-28 12:10:10 [auto1.it] INFO: Found listing with ID: MV48834
2026-03-28 12:10:10 [auto1.it] INFO: Found listing with ID: LE49462
2026-03-28 12:10:10 [auto1.it] INFO: Found listing with ID: TK35909
2026-03-28 12:10:10 [auto1.it] INFO: Found listing with ID: CA37263
2026-03-28 12:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA37263%27 HTTP/1.1" 200 None
2026-03-28 12:10:10 [auto1.it] INFO: Scrape type for CA37263: 2
2026-03-28 12:10:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bffd6156-55c4-5fb3-ae28-0526fe71e1f0 with identifier: CA37263
2026-03-28 12:10:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bffd6156-55c4-5fb3-ae28-0526fe71e1f0 with scrape type 2
2026-03-28 12:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bffd6156-55c4-5fb3-ae28-0526fe71e1f0 with scrape type 2
2026-03-28 12:10:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bffd6156-55c4-5fb3-ae28-0526fe71e1f0, identifier: CA37263
2026-03-28 12:10:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 648eb12d-9809-5171-977a-61b880c9ccc2 with identifier: PX76093
2026-03-28 12:10:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 648eb12d-9809-5171-977a-61b880c9ccc2 with identifier: PX76093
2026-03-28 12:10:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 648eb12d-9809-5171-977a-61b880c9ccc2 with identifier: PX76093 to the API
2026-03-28 12:10:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:35:53Z',
 'fuel_type': 'diesel',
 'id': '648eb12d-9809-5171-977a-61b880c9ccc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX76093',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 172913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-24',
 'seller_name': None,
 'title': 'Ford Fiesta 1.5 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2013}
2026-03-28 12:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PX76093%27 HTTP/1.1" 200 None
2026-03-28 12:10:10 [auto1.it] INFO: Saving data for PX76093: {'auction_closing_time': 1774715753.0, 'created_time': 1772568034.065341, 'last_price_update_time': 1774699810.836316}
2026-03-28 12:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PX76093') HTTP/1.1" 204 0
2026-03-28 12:10:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bffd6156-55c4-5fb3-ae28-0526fe71e1f0 with identifier: CA37263
2026-03-28 12:10:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bffd6156-55c4-5fb3-ae28-0526fe71e1f0 with identifier: CA37263
2026-03-28 12:10:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bffd6156-55c4-5fb3-ae28-0526fe71e1f0 with identifier: CA37263 to the API
2026-03-28 12:10:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:41:44Z',
 'fuel_type': 'diesel',
 'id': 'bffd6156-55c4-5fb3-ae28-0526fe71e1f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA37263',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 143730,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-31',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline 4Motion',
 'transmission': 'manual',
 'trim': 'Comfortline 4Motion',
 'year': 2009}
2026-03-28 12:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA37263%27 HTTP/1.1" 200 None
2026-03-28 12:10:11 [auto1.it] INFO: Saving data for CA37263: {'auction_closing_time': 1774716104.0, 'created_time': 1774613167.000337, 'last_price_update_time': 1774699811.101644}
2026-03-28 12:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CA37263') HTTP/1.1" 204 0
2026-03-28 12:10:11 [auto1.it] INFO: Found listing with ID: VF62325
2026-03-28 12:10:11 [auto1.it] INFO: Found listing with ID: RA11036
2026-03-28 12:10:11 [auto1.it] INFO: Found listing with ID: YY46039
2026-03-28 12:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY46039%27 HTTP/1.1" 200 None
2026-03-28 12:10:11 [auto1.it] INFO: Scrape type for YY46039: 2
2026-03-28 12:10:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 442e9b4c-0403-5d44-97ca-4cd9c6597329 with identifier: YY46039
2026-03-28 12:10:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 442e9b4c-0403-5d44-97ca-4cd9c6597329 with scrape type 2
2026-03-28 12:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 442e9b4c-0403-5d44-97ca-4cd9c6597329 with scrape type 2
2026-03-28 12:10:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 442e9b4c-0403-5d44-97ca-4cd9c6597329, identifier: YY46039
2026-03-28 12:10:11 [auto1.it] INFO: Found listing with ID: VY80184
2026-03-28 12:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY80184%27 HTTP/1.1" 200 None
2026-03-28 12:10:11 [auto1.it] INFO: Scrape type for VY80184: 2
2026-03-28 12:10:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21db4297-151f-559e-afaf-db105564f930 with identifier: VY80184
2026-03-28 12:10:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21db4297-151f-559e-afaf-db105564f930 with scrape type 2
2026-03-28 12:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21db4297-151f-559e-afaf-db105564f930 with scrape type 2
2026-03-28 12:10:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 21db4297-151f-559e-afaf-db105564f930, identifier: VY80184
2026-03-28 12:10:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 442e9b4c-0403-5d44-97ca-4cd9c6597329 with identifier: YY46039
2026-03-28 12:10:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 442e9b4c-0403-5d44-97ca-4cd9c6597329 with identifier: YY46039
2026-03-28 12:10:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 442e9b4c-0403-5d44-97ca-4cd9c6597329 with identifier: YY46039 to the API
2026-03-28 12:10:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:17:30Z',
 'fuel_type': 'diesel',
 'id': '442e9b4c-0403-5d44-97ca-4cd9c6597329',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY46039',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 121421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-11',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Business BlueMotion',
 'transmission': 'manual',
 'trim': 'Business BlueMotion',
 'year': 2018}
2026-03-28 12:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY46039%27 HTTP/1.1" 200 None
2026-03-28 12:10:11 [auto1.it] INFO: Saving data for YY46039: {'auction_closing_time': 1774714650.0, 'created_time': 1774613163.522918, 'last_price_update_time': 1774699811.589181}
2026-03-28 12:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YY46039') HTTP/1.1" 204 0
2026-03-28 12:10:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 21db4297-151f-559e-afaf-db105564f930 with identifier: VY80184
2026-03-28 12:10:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 21db4297-151f-559e-afaf-db105564f930 with identifier: VY80184
2026-03-28 12:10:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 21db4297-151f-559e-afaf-db105564f930 with identifier: VY80184 to the API
2026-03-28 12:10:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:00:22Z',
 'fuel_type': 'petrol',
 'id': '21db4297-151f-559e-afaf-db105564f930',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY80184',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 133377,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-02',
 'seller_name': None,
 'title': 'Suzuki Vitara 1.6 V-Top 4x2',
 'transmission': 'automatic',
 'trim': 'V-Top 4x2',
 'year': 2017}
2026-03-28 12:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY80184%27 HTTP/1.1" 200 None
2026-03-28 12:10:11 [auto1.it] INFO: Saving data for VY80184: {'auction_closing_time': 1774713622.0, 'created_time': 1774613180.553932, 'last_price_update_time': 1774699811.943663}
2026-03-28 12:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VY80184') HTTP/1.1" 204 0
2026-03-28 12:10:11 [auto1.it] INFO: Found listing with ID: XX32057
2026-03-28 12:10:11 [auto1.it] INFO: Found listing with ID: YL89014
2026-03-28 12:10:11 [auto1.it] INFO: Found listing with ID: HM08879
2026-03-28 12:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HM08879%27 HTTP/1.1" 200 None
2026-03-28 12:10:11 [auto1.it] INFO: Scrape type for HM08879: 2
2026-03-28 12:10:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4862b6da-7d75-5bd2-8dd4-c3852c30e088 with identifier: HM08879
2026-03-28 12:10:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4862b6da-7d75-5bd2-8dd4-c3852c30e088 with scrape type 2
2026-03-28 12:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4862b6da-7d75-5bd2-8dd4-c3852c30e088 with scrape type 2
2026-03-28 12:10:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4862b6da-7d75-5bd2-8dd4-c3852c30e088, identifier: HM08879
2026-03-28 12:10:12 [auto1.it] INFO: Found listing with ID: CB33793
2026-03-28 12:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB33793%27 HTTP/1.1" 200 None
2026-03-28 12:10:12 [auto1.it] INFO: Scrape type for CB33793: 2
2026-03-28 12:10:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: becef827-8630-50fe-91ca-153aa9448814 with identifier: CB33793
2026-03-28 12:10:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item becef827-8630-50fe-91ca-153aa9448814 with scrape type 2
2026-03-28 12:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item becef827-8630-50fe-91ca-153aa9448814 with scrape type 2
2026-03-28 12:10:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: becef827-8630-50fe-91ca-153aa9448814, identifier: CB33793
2026-03-28 12:10:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4862b6da-7d75-5bd2-8dd4-c3852c30e088 with identifier: HM08879
2026-03-28 12:10:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4862b6da-7d75-5bd2-8dd4-c3852c30e088 with identifier: HM08879
2026-03-28 12:10:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4862b6da-7d75-5bd2-8dd4-c3852c30e088 with identifier: HM08879 to the API
2026-03-28 12:10:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:25:04Z',
 'fuel_type': 'petrol',
 'id': '4862b6da-7d75-5bd2-8dd4-c3852c30e088',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM08879',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 108557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-21',
 'seller_name': None,
 'title': 'Renault Captur 0.9 Energy Wave',
 'transmission': 'manual',
 'trim': 'Wave',
 'year': 2015}
2026-03-28 12:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HM08879%27 HTTP/1.1" 200 None
2026-03-28 12:10:12 [auto1.it] INFO: Saving data for HM08879: {'auction_closing_time': 1774715104.0, 'created_time': 1774613168.681766, 'last_price_update_time': 1774699812.432785}
2026-03-28 12:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HM08879') HTTP/1.1" 204 0
2026-03-28 12:10:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: becef827-8630-50fe-91ca-153aa9448814 with identifier: CB33793
2026-03-28 12:10:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: becef827-8630-50fe-91ca-153aa9448814 with identifier: CB33793
2026-03-28 12:10:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: becef827-8630-50fe-91ca-153aa9448814 with identifier: CB33793 to the API
2026-03-28 12:10:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:52:09Z',
 'fuel_type': 'petrol',
 'id': 'becef827-8630-50fe-91ca-153aa9448814',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB33793',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 91624,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-15',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2016}
2026-03-28 12:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB33793%27 HTTP/1.1" 200 None
2026-03-28 12:10:12 [auto1.it] INFO: Saving data for CB33793: {'auction_closing_time': 1774716729.0, 'created_time': 1774613147.84075, 'last_price_update_time': 1774699812.685252}
2026-03-28 12:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CB33793') HTTP/1.1" 204 0
2026-03-28 12:10:12 [auto1.it] INFO: Found listing with ID: FP35914
2026-03-28 12:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP35914%27 HTTP/1.1" 200 None
2026-03-28 12:10:12 [auto1.it] INFO: Scrape type for FP35914: 0
2026-03-28 12:10:12 [auto1.it] INFO: Found listing with ID: GC53002
2026-03-28 12:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC53002%27 HTTP/1.1" 200 None
2026-03-28 12:10:12 [auto1.it] INFO: Scrape type for GC53002: 2
2026-03-28 12:10:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a7e8dcd-e4a5-5693-864d-5a7588f97cd6 with identifier: GC53002
2026-03-28 12:10:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a7e8dcd-e4a5-5693-864d-5a7588f97cd6 with scrape type 2
2026-03-28 12:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a7e8dcd-e4a5-5693-864d-5a7588f97cd6 with scrape type 2
2026-03-28 12:10:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7a7e8dcd-e4a5-5693-864d-5a7588f97cd6, identifier: GC53002
2026-03-28 12:10:12 [auto1.it] INFO: Found listing with ID: XV63353
2026-03-28 12:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV63353%27 HTTP/1.1" 200 None
2026-03-28 12:10:12 [auto1.it] INFO: Scrape type for XV63353: 2
2026-03-28 12:10:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5c034fb-c698-5942-bfb4-88fc7464b760 with identifier: XV63353
2026-03-28 12:10:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5c034fb-c698-5942-bfb4-88fc7464b760 with scrape type 2
2026-03-28 12:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5c034fb-c698-5942-bfb4-88fc7464b760 with scrape type 2
2026-03-28 12:10:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d5c034fb-c698-5942-bfb4-88fc7464b760, identifier: XV63353
2026-03-28 12:10:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7a7e8dcd-e4a5-5693-864d-5a7588f97cd6 with identifier: GC53002
2026-03-28 12:10:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7a7e8dcd-e4a5-5693-864d-5a7588f97cd6 with identifier: GC53002
2026-03-28 12:10:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7a7e8dcd-e4a5-5693-864d-5a7588f97cd6 with identifier: GC53002 to the API
2026-03-28 12:10:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:21:09Z',
 'fuel_type': 'diesel',
 'id': '7a7e8dcd-e4a5-5693-864d-5a7588f97cd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC53002',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 237014,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-03-09',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2003}
2026-03-28 12:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC53002%27 HTTP/1.1" 200 None
2026-03-28 12:10:13 [auto1.it] INFO: Saving data for GC53002: {'auction_closing_time': 1774714869.0, 'created_time': 1773130049.911062, 'last_price_update_time': 1774699813.1806}
2026-03-28 12:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GC53002') HTTP/1.1" 204 0
2026-03-28 12:10:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d5c034fb-c698-5942-bfb4-88fc7464b760 with identifier: XV63353
2026-03-28 12:10:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d5c034fb-c698-5942-bfb4-88fc7464b760 with identifier: XV63353
2026-03-28 12:10:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d5c034fb-c698-5942-bfb4-88fc7464b760 with identifier: XV63353 to the API
2026-03-28 12:10:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:02:20Z',
 'fuel_type': 'petrol',
 'id': 'd5c034fb-c698-5942-bfb4-88fc7464b760',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV63353',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Taigo',
 'odometer': 9648,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-07-27',
 'seller_name': None,
 'title': 'Volkswagen Taigo 1.0 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2025}
2026-03-28 12:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV63353%27 HTTP/1.1" 200 None
2026-03-28 12:10:13 [auto1.it] INFO: Saving data for XV63353: {'auction_closing_time': 1774713740.0, 'created_time': 1774613148.526478, 'last_price_update_time': 1774699813.47689}
2026-03-28 12:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XV63353') HTTP/1.1" 204 0
2026-03-28 12:10:13 [auto1.it] INFO: Found listing with ID: YB89619
2026-03-28 12:10:13 [auto1.it] INFO: Found listing with ID: FV19054
2026-03-28 12:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FV19054%27 HTTP/1.1" 200 None
2026-03-28 12:10:13 [auto1.it] INFO: Scrape type for FV19054: 2
2026-03-28 12:10:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 071191a3-b913-53f4-8ebe-4d6b7e08f1ba with identifier: FV19054
2026-03-28 12:10:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 071191a3-b913-53f4-8ebe-4d6b7e08f1ba with scrape type 2
2026-03-28 12:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 071191a3-b913-53f4-8ebe-4d6b7e08f1ba with scrape type 2
2026-03-28 12:10:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 071191a3-b913-53f4-8ebe-4d6b7e08f1ba, identifier: FV19054
2026-03-28 12:10:13 [auto1.it] INFO: Found listing with ID: VS63057
2026-03-28 12:10:13 [auto1.it] INFO: Found listing with ID: KB12646
2026-03-28 12:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KB12646%27 HTTP/1.1" 200 None
2026-03-28 12:10:13 [auto1.it] INFO: Scrape type for KB12646: 2
2026-03-28 12:10:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb12b08b-f86a-5586-8e24-d656b825e4bb with identifier: KB12646
2026-03-28 12:10:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb12b08b-f86a-5586-8e24-d656b825e4bb with scrape type 2
2026-03-28 12:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb12b08b-f86a-5586-8e24-d656b825e4bb with scrape type 2
2026-03-28 12:10:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cb12b08b-f86a-5586-8e24-d656b825e4bb, identifier: KB12646
2026-03-28 12:10:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 071191a3-b913-53f4-8ebe-4d6b7e08f1ba with identifier: FV19054
2026-03-28 12:10:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:10:13 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-28 12:10:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:10:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 071191a3-b913-53f4-8ebe-4d6b7e08f1ba with identifier: FV19054
2026-03-28 12:10:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 071191a3-b913-53f4-8ebe-4d6b7e08f1ba with identifier: FV19054 to the API
2026-03-28 12:10:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:58:37Z',
 'fuel_type': 'diesel',
 'id': '071191a3-b913-53f4-8ebe-4d6b7e08f1ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV19054',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 119145,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-29',
 'seller_name': None,
 'title': 'Ford Fiesta 1.5 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2013}
2026-03-28 12:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FV19054%27 HTTP/1.1" 200 None
2026-03-28 12:10:14 [auto1.it] INFO: Saving data for FV19054: {'auction_closing_time': 1774717117.0, 'created_time': 1774613153.888333, 'last_price_update_time': 1774699814.072693}
2026-03-28 12:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FV19054') HTTP/1.1" 204 0
2026-03-28 12:10:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cb12b08b-f86a-5586-8e24-d656b825e4bb with identifier: KB12646
2026-03-28 12:10:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cb12b08b-f86a-5586-8e24-d656b825e4bb with identifier: KB12646
2026-03-28 12:10:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cb12b08b-f86a-5586-8e24-d656b825e4bb with identifier: KB12646 to the API
2026-03-28 12:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:54:04Z',
 'fuel_type': 'diesel',
 'id': 'cb12b08b-f86a-5586-8e24-d656b825e4bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB12646',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 84469,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-07',
 'seller_name': None,
 'title': 'BMW 3er 330d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2014}
2026-03-28 12:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KB12646%27 HTTP/1.1" 200 None
2026-03-28 12:10:14 [auto1.it] INFO: Saving data for KB12646: {'auction_closing_time': 1774716844.0, 'created_time': 1774613157.928753, 'last_price_update_time': 1774699814.43633}
2026-03-28 12:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KB12646') HTTP/1.1" 204 0
2026-03-28 12:10:14 [auto1.it] INFO: Found listing with ID: CU49337
2026-03-28 12:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU49337%27 HTTP/1.1" 200 None
2026-03-28 12:10:14 [auto1.it] INFO: Scrape type for CU49337: 2
2026-03-28 12:10:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ddf9375-0e14-5e71-867a-a14576cd00f7 with identifier: CU49337
2026-03-28 12:10:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ddf9375-0e14-5e71-867a-a14576cd00f7 with scrape type 2
2026-03-28 12:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ddf9375-0e14-5e71-867a-a14576cd00f7 with scrape type 2
2026-03-28 12:10:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8ddf9375-0e14-5e71-867a-a14576cd00f7, identifier: CU49337
2026-03-28 12:10:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8ddf9375-0e14-5e71-867a-a14576cd00f7 with identifier: CU49337
2026-03-28 12:10:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8ddf9375-0e14-5e71-867a-a14576cd00f7 with identifier: CU49337
2026-03-28 12:10:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8ddf9375-0e14-5e71-867a-a14576cd00f7 with identifier: CU49337 to the API
2026-03-28 12:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:45:02Z',
 'fuel_type': 'diesel',
 'id': '8ddf9375-0e14-5e71-867a-a14576cd00f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU49337',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 249891,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-30',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.6 JTDM Distinctive',
 'transmission': 'manual',
 'trim': 'Distinctive',
 'year': 2014}
2026-03-28 12:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU49337%27 HTTP/1.1" 200 None
2026-03-28 12:10:14 [auto1.it] INFO: Saving data for CU49337: {'auction_closing_time': 1774716302.0, 'created_time': 1774613155.767584, 'last_price_update_time': 1774699814.844628}
2026-03-28 12:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CU49337') HTTP/1.1" 204 0
2026-03-28 12:10:14 [auto1.it] INFO: Found listing with ID: DK62006
2026-03-28 12:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK62006%27 HTTP/1.1" 200 None
2026-03-28 12:10:14 [auto1.it] INFO: Scrape type for DK62006: 2
2026-03-28 12:10:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa10fcb2-7b49-5013-a84d-8d2514097f62 with identifier: DK62006
2026-03-28 12:10:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa10fcb2-7b49-5013-a84d-8d2514097f62 with scrape type 2
2026-03-28 12:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa10fcb2-7b49-5013-a84d-8d2514097f62 with scrape type 2
2026-03-28 12:10:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fa10fcb2-7b49-5013-a84d-8d2514097f62, identifier: DK62006
2026-03-28 12:10:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fa10fcb2-7b49-5013-a84d-8d2514097f62 with identifier: DK62006
2026-03-28 12:10:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fa10fcb2-7b49-5013-a84d-8d2514097f62 with identifier: DK62006
2026-03-28 12:10:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fa10fcb2-7b49-5013-a84d-8d2514097f62 with identifier: DK62006 to the API
2026-03-28 12:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:34:55Z',
 'fuel_type': 'diesel',
 'id': 'fa10fcb2-7b49-5013-a84d-8d2514097f62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK62006',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 104535,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-30',
 'seller_name': None,
 'title': 'Peugeot 207 1.4 HDi X-Line',
 'transmission': 'manual',
 'trim': 'X-Line',
 'year': 2007}
2026-03-28 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK62006%27 HTTP/1.1" 200 None
2026-03-28 12:10:15 [auto1.it] INFO: Saving data for DK62006: {'auction_closing_time': 1774715695.0, 'created_time': 1774613155.361793, 'last_price_update_time': 1774699815.226279}
2026-03-28 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DK62006') HTTP/1.1" 204 0
2026-03-28 12:10:15 [auto1.it] INFO: Found listing with ID: SR32433
2026-03-28 12:10:15 [auto1.it] INFO: Found listing with ID: BA09093
2026-03-28 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA09093%27 HTTP/1.1" 200 None
2026-03-28 12:10:15 [auto1.it] INFO: Scrape type for BA09093: 2
2026-03-28 12:10:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5000e088-d6e7-5df2-809c-960866798bd8 with identifier: BA09093
2026-03-28 12:10:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5000e088-d6e7-5df2-809c-960866798bd8 with scrape type 2
2026-03-28 12:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5000e088-d6e7-5df2-809c-960866798bd8 with scrape type 2
2026-03-28 12:10:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5000e088-d6e7-5df2-809c-960866798bd8, identifier: BA09093
2026-03-28 12:10:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5000e088-d6e7-5df2-809c-960866798bd8 with identifier: BA09093
2026-03-28 12:10:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5000e088-d6e7-5df2-809c-960866798bd8 with identifier: BA09093
2026-03-28 12:10:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5000e088-d6e7-5df2-809c-960866798bd8 with identifier: BA09093 to the API
2026-03-28 12:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:21:10Z',
 'fuel_type': 'diesel',
 'id': '5000e088-d6e7-5df2-809c-960866798bd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA09093',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 204423,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-28',
 'seller_name': None,
 'title': 'BMW 1er 120d',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-28 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA09093%27 HTTP/1.1" 200 None
2026-03-28 12:10:15 [auto1.it] INFO: Saving data for BA09093: {'auction_closing_time': 1774714870.0, 'created_time': 1774613157.55715, 'last_price_update_time': 1774699815.617405}
2026-03-28 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BA09093') HTTP/1.1" 204 0
2026-03-28 12:10:15 [auto1.it] INFO: Found listing with ID: BR57787
2026-03-28 12:10:15 [auto1.it] INFO: Found listing with ID: TY97368
2026-03-28 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY97368%27 HTTP/1.1" 200 None
2026-03-28 12:10:15 [auto1.it] INFO: Scrape type for TY97368: 2
2026-03-28 12:10:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b125a6cb-2925-5d32-a067-71fc2ad8769b with identifier: TY97368
2026-03-28 12:10:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b125a6cb-2925-5d32-a067-71fc2ad8769b with scrape type 2
2026-03-28 12:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b125a6cb-2925-5d32-a067-71fc2ad8769b with scrape type 2
2026-03-28 12:10:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b125a6cb-2925-5d32-a067-71fc2ad8769b, identifier: TY97368
2026-03-28 12:10:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b125a6cb-2925-5d32-a067-71fc2ad8769b with identifier: TY97368
2026-03-28 12:10:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b125a6cb-2925-5d32-a067-71fc2ad8769b with identifier: TY97368
2026-03-28 12:10:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b125a6cb-2925-5d32-a067-71fc2ad8769b with identifier: TY97368 to the API
2026-03-28 12:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:47:58Z',
 'fuel_type': 'diesel',
 'id': 'b125a6cb-2925-5d32-a067-71fc2ad8769b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY97368',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 192073,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-22',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2010}
2026-03-28 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY97368%27 HTTP/1.1" 200 None
2026-03-28 12:10:15 [auto1.it] INFO: Saving data for TY97368: {'auction_closing_time': 1774716478.0, 'created_time': 1774613160.73958, 'last_price_update_time': 1774699815.97971}
2026-03-28 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TY97368') HTTP/1.1" 204 0
2026-03-28 12:10:15 [auto1.it] INFO: Found listing with ID: GV26258
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV26258%27 HTTP/1.1" 200 None
2026-03-28 12:10:16 [auto1.it] INFO: Scrape type for GV26258: 2
2026-03-28 12:10:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b6afd2a-db5c-5180-b87c-7c5762bace28 with identifier: GV26258
2026-03-28 12:10:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b6afd2a-db5c-5180-b87c-7c5762bace28 with scrape type 2
2026-03-28 12:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b6afd2a-db5c-5180-b87c-7c5762bace28 with scrape type 2
2026-03-28 12:10:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8b6afd2a-db5c-5180-b87c-7c5762bace28, identifier: GV26258
2026-03-28 12:10:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8b6afd2a-db5c-5180-b87c-7c5762bace28 with identifier: GV26258
2026-03-28 12:10:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8b6afd2a-db5c-5180-b87c-7c5762bace28 with identifier: GV26258
2026-03-28 12:10:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8b6afd2a-db5c-5180-b87c-7c5762bace28 with identifier: GV26258 to the API
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:08:24Z',
 'fuel_type': 'diesel',
 'id': '8b6afd2a-db5c-5180-b87c-7c5762bace28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV26258',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 307590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-22',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Trend & Fun BlueMotion',
 'transmission': 'manual',
 'trim': 'Trend & Fun BlueMotion',
 'year': 2011}
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV26258%27 HTTP/1.1" 200 None
2026-03-28 12:10:16 [auto1.it] INFO: Saving data for GV26258: {'auction_closing_time': 1774714104.0, 'created_time': 1774613162.815896, 'last_price_update_time': 1774699816.367871}
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GV26258') HTTP/1.1" 204 0
2026-03-28 12:10:16 [auto1.it] INFO: Found listing with ID: VY84485
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY84485%27 HTTP/1.1" 200 None
2026-03-28 12:10:16 [auto1.it] INFO: Scrape type for VY84485: 2
2026-03-28 12:10:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7eafafbd-f0ef-592f-8a89-7bedb9ef7bf2 with identifier: VY84485
2026-03-28 12:10:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7eafafbd-f0ef-592f-8a89-7bedb9ef7bf2 with scrape type 2
2026-03-28 12:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7eafafbd-f0ef-592f-8a89-7bedb9ef7bf2 with scrape type 2
2026-03-28 12:10:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7eafafbd-f0ef-592f-8a89-7bedb9ef7bf2, identifier: VY84485
2026-03-28 12:10:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7eafafbd-f0ef-592f-8a89-7bedb9ef7bf2 with identifier: VY84485
2026-03-28 12:10:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7eafafbd-f0ef-592f-8a89-7bedb9ef7bf2 with identifier: VY84485
2026-03-28 12:10:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7eafafbd-f0ef-592f-8a89-7bedb9ef7bf2 with identifier: VY84485 to the API
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:42:33Z',
 'fuel_type': 'diesel',
 'id': '7eafafbd-f0ef-592f-8a89-7bedb9ef7bf2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY84485',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLB-Klasse',
 'odometer': 87820,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-08',
 'seller_name': None,
 'title': 'Mercedes-Benz GLB-Klasse GLB 180 d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY84485%27 HTTP/1.1" 200 None
2026-03-28 12:10:16 [auto1.it] INFO: Saving data for VY84485: {'auction_closing_time': 1774716153.0, 'created_time': 1774613161.953814, 'last_price_update_time': 1774699816.766341}
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VY84485') HTTP/1.1" 204 0
2026-03-28 12:10:16 [auto1.it] INFO: Found listing with ID: ZX85690
2026-03-28 12:10:16 [auto1.it] INFO: Found listing with ID: TE87413
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TE87413%27 HTTP/1.1" 200 None
2026-03-28 12:10:16 [auto1.it] INFO: Scrape type for TE87413: 2
2026-03-28 12:10:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43d25b6d-4ad9-5b2b-9637-a9f10060474d with identifier: TE87413
2026-03-28 12:10:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43d25b6d-4ad9-5b2b-9637-a9f10060474d with scrape type 2
2026-03-28 12:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43d25b6d-4ad9-5b2b-9637-a9f10060474d with scrape type 2
2026-03-28 12:10:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 43d25b6d-4ad9-5b2b-9637-a9f10060474d, identifier: TE87413
2026-03-28 12:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 43d25b6d-4ad9-5b2b-9637-a9f10060474d with identifier: TE87413
2026-03-28 12:10:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 43d25b6d-4ad9-5b2b-9637-a9f10060474d with identifier: TE87413
2026-03-28 12:10:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 43d25b6d-4ad9-5b2b-9637-a9f10060474d with identifier: TE87413 to the API
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:33:21Z',
 'fuel_type': 'diesel',
 'id': '43d25b6d-4ad9-5b2b-9637-a9f10060474d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE87413',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 118048,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-16',
 'seller_name': None,
 'title': 'Opel Astra 1.5 CDTI Business Elegance Start/Stop',
 'transmission': 'manual',
 'trim': 'Business Elegance Start/Stop',
 'year': 2019}
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TE87413%27 HTTP/1.1" 200 None
2026-03-28 12:10:17 [auto1.it] INFO: Saving data for TE87413: {'auction_closing_time': 1774715601.0, 'created_time': 1774613162.349235, 'last_price_update_time': 1774699817.187564}
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TE87413') HTTP/1.1" 204 0
2026-03-28 12:10:17 [auto1.it] INFO: Found listing with ID: SY54924
2026-03-28 12:10:17 [auto1.it] INFO: Found listing with ID: UD61425
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD61425%27 HTTP/1.1" 200 None
2026-03-28 12:10:17 [auto1.it] INFO: Scrape type for UD61425: 2
2026-03-28 12:10:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dd9d39e-0d93-5c60-ada0-f3f184ab698d with identifier: UD61425
2026-03-28 12:10:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dd9d39e-0d93-5c60-ada0-f3f184ab698d with scrape type 2
2026-03-28 12:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2dd9d39e-0d93-5c60-ada0-f3f184ab698d with scrape type 2
2026-03-28 12:10:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2dd9d39e-0d93-5c60-ada0-f3f184ab698d, identifier: UD61425
2026-03-28 12:10:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2dd9d39e-0d93-5c60-ada0-f3f184ab698d with identifier: UD61425
2026-03-28 12:10:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2dd9d39e-0d93-5c60-ada0-f3f184ab698d with identifier: UD61425
2026-03-28 12:10:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2dd9d39e-0d93-5c60-ada0-f3f184ab698d with identifier: UD61425 to the API
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:23:27Z',
 'fuel_type': 'petrol',
 'id': '2dd9d39e-0d93-5c60-ada0-f3f184ab698d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD61425',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 121397,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-28',
 'seller_name': None,
 'title': 'Honda Jazz 1.3 i-VTEC Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2019}
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD61425%27 HTTP/1.1" 200 None
2026-03-28 12:10:17 [auto1.it] INFO: Saving data for UD61425: {'auction_closing_time': 1774715007.0, 'created_time': 1774613287.937318, 'last_price_update_time': 1774699817.615719}
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UD61425') HTTP/1.1" 204 0
2026-03-28 12:10:17 [auto1.it] INFO: Found listing with ID: UF75242
2026-03-28 12:10:17 [auto1.it] INFO: Found listing with ID: MG67619
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG67619%27 HTTP/1.1" 200 None
2026-03-28 12:10:17 [auto1.it] INFO: Scrape type for MG67619: 2
2026-03-28 12:10:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a8f4f4f-4925-5c2b-b146-a6243f1fd814 with identifier: MG67619
2026-03-28 12:10:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a8f4f4f-4925-5c2b-b146-a6243f1fd814 with scrape type 2
2026-03-28 12:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a8f4f4f-4925-5c2b-b146-a6243f1fd814 with scrape type 2
2026-03-28 12:10:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0a8f4f4f-4925-5c2b-b146-a6243f1fd814, identifier: MG67619
2026-03-28 12:10:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0a8f4f4f-4925-5c2b-b146-a6243f1fd814 with identifier: MG67619
2026-03-28 12:10:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0a8f4f4f-4925-5c2b-b146-a6243f1fd814 with identifier: MG67619
2026-03-28 12:10:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0a8f4f4f-4925-5c2b-b146-a6243f1fd814 with identifier: MG67619 to the API
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:17:25Z',
 'fuel_type': 'diesel',
 'id': '0a8f4f4f-4925-5c2b-b146-a6243f1fd814',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG67619',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 327154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-12',
 'seller_name': None,
 'title': 'BMW 5er 520d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2014}
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG67619%27 HTTP/1.1" 200 None
2026-03-28 12:10:18 [auto1.it] INFO: Saving data for MG67619: {'auction_closing_time': 1774714645.0, 'created_time': 1773131547.772051, 'last_price_update_time': 1774699818.146952}
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MG67619') HTTP/1.1" 204 0
2026-03-28 12:10:18 [auto1.it] INFO: Channel: 24h | Page: 75 | totalHits: 3675 | hits on page: 40
2026-03-28 12:10:18 [auto1.it] INFO: Found listing with ID: VZ32715
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VZ32715%27 HTTP/1.1" 200 None
2026-03-28 12:10:18 [auto1.it] INFO: Scrape type for VZ32715: 2
2026-03-28 12:10:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49193985-e63a-5242-a21a-68655079b7c2 with identifier: VZ32715
2026-03-28 12:10:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49193985-e63a-5242-a21a-68655079b7c2 with scrape type 2
2026-03-28 12:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49193985-e63a-5242-a21a-68655079b7c2 with scrape type 2
2026-03-28 12:10:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 49193985-e63a-5242-a21a-68655079b7c2, identifier: VZ32715
2026-03-28 12:10:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 49193985-e63a-5242-a21a-68655079b7c2 with identifier: VZ32715
2026-03-28 12:10:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 49193985-e63a-5242-a21a-68655079b7c2 with identifier: VZ32715
2026-03-28 12:10:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 49193985-e63a-5242-a21a-68655079b7c2 with identifier: VZ32715 to the API
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:05:40Z',
 'fuel_type': 'diesel',
 'id': '49193985-e63a-5242-a21a-68655079b7c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ32715',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 193890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-10',
 'seller_name': None,
 'title': 'Citroen Jumpy 1.6 Blue-HDi M',
 'transmission': 'manual',
 'trim': 'M',
 'year': 2019}
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VZ32715%27 HTTP/1.1" 200 None
2026-03-28 12:10:18 [auto1.it] INFO: Saving data for VZ32715: {'auction_closing_time': 1774713940.0, 'created_time': 1774613296.528077, 'last_price_update_time': 1774699818.543714}
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VZ32715') HTTP/1.1" 204 0
2026-03-28 12:10:18 [auto1.it] INFO: Found listing with ID: RF78298
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF78298%27 HTTP/1.1" 200 None
2026-03-28 12:10:18 [auto1.it] INFO: Scrape type for RF78298: 2
2026-03-28 12:10:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43c7d9fa-ae9b-5fdb-8225-a98ff69b3ad6 with identifier: RF78298
2026-03-28 12:10:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43c7d9fa-ae9b-5fdb-8225-a98ff69b3ad6 with scrape type 2
2026-03-28 12:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43c7d9fa-ae9b-5fdb-8225-a98ff69b3ad6 with scrape type 2
2026-03-28 12:10:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 43c7d9fa-ae9b-5fdb-8225-a98ff69b3ad6, identifier: RF78298
2026-03-28 12:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:18 [auto1.it] INFO: Found listing with ID: AF86061
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF86061%27 HTTP/1.1" 200 None
2026-03-28 12:10:18 [auto1.it] INFO: Scrape type for AF86061: 2
2026-03-28 12:10:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04022b85-c6d9-580b-95c1-03aabca77f55 with identifier: AF86061
2026-03-28 12:10:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04022b85-c6d9-580b-95c1-03aabca77f55 with scrape type 2
2026-03-28 12:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04022b85-c6d9-580b-95c1-03aabca77f55 with scrape type 2
2026-03-28 12:10:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 04022b85-c6d9-580b-95c1-03aabca77f55, identifier: AF86061
2026-03-28 12:10:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 43c7d9fa-ae9b-5fdb-8225-a98ff69b3ad6 with identifier: RF78298
2026-03-28 12:10:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 43c7d9fa-ae9b-5fdb-8225-a98ff69b3ad6 with identifier: RF78298
2026-03-28 12:10:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 43c7d9fa-ae9b-5fdb-8225-a98ff69b3ad6 with identifier: RF78298 to the API
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 179,
 'expiration_date': '2026-03-28T16:00:51Z',
 'fuel_type': 'petrol',
 'id': '43c7d9fa-ae9b-5fdb-8225-a98ff69b3ad6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF78298',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 72704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-06',
 'seller_name': None,
 'title': 'Jeep Renegade 1.3 TGDi Limited 4x4',
 'transmission': 'automatic',
 'trim': 'Limited 4x4',
 'year': 2019}
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF78298%27 HTTP/1.1" 200 None
2026-03-28 12:10:19 [auto1.it] INFO: Saving data for RF78298: {'auction_closing_time': 1774713651.0, 'created_time': 1774613187.848711, 'last_price_update_time': 1774699819.041896}
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RF78298') HTTP/1.1" 204 0
2026-03-28 12:10:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 04022b85-c6d9-580b-95c1-03aabca77f55 with identifier: AF86061
2026-03-28 12:10:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 04022b85-c6d9-580b-95c1-03aabca77f55 with identifier: AF86061
2026-03-28 12:10:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 04022b85-c6d9-580b-95c1-03aabca77f55 with identifier: AF86061 to the API
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:01:30Z',
 'fuel_type': 'petrol',
 'id': '04022b85-c6d9-580b-95c1-03aabca77f55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF86061',
 'listing': 'auction',
 'make': 'Abarth',
 'model': '500',
 'odometer': 95786,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-29',
 'seller_name': None,
 'title': 'Abarth 500 1.4 Turbo',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF86061%27 HTTP/1.1" 200 None
2026-03-28 12:10:19 [auto1.it] INFO: Saving data for AF86061: {'auction_closing_time': 1774713690.0, 'created_time': 1773131040.656163, 'last_price_update_time': 1774699819.32831}
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AF86061') HTTP/1.1" 204 0
2026-03-28 12:10:19 [auto1.it] INFO: Found listing with ID: VD83585
2026-03-28 12:10:19 [auto1.it] INFO: Found listing with ID: XW70858
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW70858%27 HTTP/1.1" 200 None
2026-03-28 12:10:19 [auto1.it] INFO: Scrape type for XW70858: 2
2026-03-28 12:10:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0897657a-c9b5-5fc8-a23d-6e7179e480d0 with identifier: XW70858
2026-03-28 12:10:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0897657a-c9b5-5fc8-a23d-6e7179e480d0 with scrape type 2
2026-03-28 12:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0897657a-c9b5-5fc8-a23d-6e7179e480d0 with scrape type 2
2026-03-28 12:10:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0897657a-c9b5-5fc8-a23d-6e7179e480d0, identifier: XW70858
2026-03-28 12:10:19 [auto1.it] INFO: Found listing with ID: UK70353
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK70353%27 HTTP/1.1" 200 None
2026-03-28 12:10:19 [auto1.it] INFO: Scrape type for UK70353: 2
2026-03-28 12:10:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b721c07a-575f-5ffe-93d0-f0bf0b67cb25 with identifier: UK70353
2026-03-28 12:10:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b721c07a-575f-5ffe-93d0-f0bf0b67cb25 with scrape type 2
2026-03-28 12:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b721c07a-575f-5ffe-93d0-f0bf0b67cb25 with scrape type 2
2026-03-28 12:10:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b721c07a-575f-5ffe-93d0-f0bf0b67cb25, identifier: UK70353
2026-03-28 12:10:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0897657a-c9b5-5fc8-a23d-6e7179e480d0 with identifier: XW70858
2026-03-28 12:10:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0897657a-c9b5-5fc8-a23d-6e7179e480d0 with identifier: XW70858
2026-03-28 12:10:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0897657a-c9b5-5fc8-a23d-6e7179e480d0 with identifier: XW70858 to the API
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 106,
 'expiration_date': '2026-03-28T16:08:40Z',
 'fuel_type': 'petrol',
 'id': '0897657a-c9b5-5fc8-a23d-6e7179e480d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW70858',
 'listing': 'auction',
 'make': 'MG',
 'model': 'ZS',
 'odometer': 67444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-27',
 'seller_name': None,
 'title': 'MG ZS 1.5 VTi Luxury',
 'transmission': 'manual',
 'trim': 'Luxury',
 'year': 2024}
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW70858%27 HTTP/1.1" 200 None
2026-03-28 12:10:19 [auto1.it] INFO: Saving data for XW70858: {'auction_closing_time': 1774714120.0, 'created_time': 1774613197.637053, 'last_price_update_time': 1774699819.82591}
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XW70858') HTTP/1.1" 204 0
2026-03-28 12:10:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b721c07a-575f-5ffe-93d0-f0bf0b67cb25 with identifier: UK70353
2026-03-28 12:10:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b721c07a-575f-5ffe-93d0-f0bf0b67cb25 with identifier: UK70353
2026-03-28 12:10:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b721c07a-575f-5ffe-93d0-f0bf0b67cb25 with identifier: UK70353 to the API
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:56:29Z',
 'fuel_type': 'diesel',
 'id': 'b721c07a-575f-5ffe-93d0-f0bf0b67cb25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK70353',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 107396,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-19',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2018}
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK70353%27 HTTP/1.1" 200 None
2026-03-28 12:10:20 [auto1.it] INFO: Saving data for UK70353: {'auction_closing_time': 1774716989.0, 'created_time': 1774613204.98336, 'last_price_update_time': 1774699820.104149}
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UK70353') HTTP/1.1" 204 0
2026-03-28 12:10:20 [auto1.it] INFO: Found listing with ID: RV11940
2026-03-28 12:10:20 [auto1.it] INFO: Found listing with ID: PN28374
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN28374%27 HTTP/1.1" 200 None
2026-03-28 12:10:20 [auto1.it] INFO: Scrape type for PN28374: 2
2026-03-28 12:10:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98a2802b-dfa1-5912-a0ed-b4e599f16ca5 with identifier: PN28374
2026-03-28 12:10:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98a2802b-dfa1-5912-a0ed-b4e599f16ca5 with scrape type 2
2026-03-28 12:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98a2802b-dfa1-5912-a0ed-b4e599f16ca5 with scrape type 2
2026-03-28 12:10:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 98a2802b-dfa1-5912-a0ed-b4e599f16ca5, identifier: PN28374
2026-03-28 12:10:20 [auto1.it] INFO: Found listing with ID: GV49335
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV49335%27 HTTP/1.1" 200 None
2026-03-28 12:10:20 [auto1.it] INFO: Scrape type for GV49335: 2
2026-03-28 12:10:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04c6b709-2478-52e5-be60-18a0f429b4a5 with identifier: GV49335
2026-03-28 12:10:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04c6b709-2478-52e5-be60-18a0f429b4a5 with scrape type 2
2026-03-28 12:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04c6b709-2478-52e5-be60-18a0f429b4a5 with scrape type 2
2026-03-28 12:10:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 04c6b709-2478-52e5-be60-18a0f429b4a5, identifier: GV49335
2026-03-28 12:10:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 98a2802b-dfa1-5912-a0ed-b4e599f16ca5 with identifier: PN28374
2026-03-28 12:10:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 98a2802b-dfa1-5912-a0ed-b4e599f16ca5 with identifier: PN28374
2026-03-28 12:10:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 98a2802b-dfa1-5912-a0ed-b4e599f16ca5 with identifier: PN28374 to the API
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 235,
 'expiration_date': '2026-03-28T16:27:49Z',
 'fuel_type': 'diesel',
 'id': '98a2802b-dfa1-5912-a0ed-b4e599f16ca5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN28374',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V90 Cross Country',
 'odometer': 185325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-20',
 'seller_name': None,
 'title': 'Volvo V90 Cross Country 2.0 D5 Pro AWD',
 'transmission': 'automatic',
 'trim': 'Pro AWD',
 'year': 2017}
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN28374%27 HTTP/1.1" 200 None
2026-03-28 12:10:20 [auto1.it] INFO: Saving data for PN28374: {'auction_closing_time': 1774715269.0, 'created_time': 1773135999.321662, 'last_price_update_time': 1774699820.599145}
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PN28374') HTTP/1.1" 204 0
2026-03-28 12:10:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 04c6b709-2478-52e5-be60-18a0f429b4a5 with identifier: GV49335
2026-03-28 12:10:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 04c6b709-2478-52e5-be60-18a0f429b4a5 with identifier: GV49335
2026-03-28 12:10:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 04c6b709-2478-52e5-be60-18a0f429b4a5 with identifier: GV49335 to the API
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:19:17Z',
 'fuel_type': 'diesel',
 'id': '04c6b709-2478-52e5-be60-18a0f429b4a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV49335',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 307374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-27',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2018}
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV49335%27 HTTP/1.1" 200 None
2026-03-28 12:10:20 [auto1.it] INFO: Saving data for GV49335: {'auction_closing_time': 1774714757.0, 'created_time': 1774613199.670013, 'last_price_update_time': 1774699820.958342}
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GV49335') HTTP/1.1" 204 0
2026-03-28 12:10:20 [auto1.it] INFO: Found listing with ID: KE46739
2026-03-28 12:10:20 [auto1.it] INFO: Found listing with ID: JE85806
2026-03-28 12:10:20 [auto1.it] INFO: Found listing with ID: LS28867
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS28867%27 HTTP/1.1" 200 None
2026-03-28 12:10:20 [auto1.it] INFO: Scrape type for LS28867: 2
2026-03-28 12:10:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8391552c-c8f7-53ed-8132-b85a65ea562f with identifier: LS28867
2026-03-28 12:10:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8391552c-c8f7-53ed-8132-b85a65ea562f with scrape type 2
2026-03-28 12:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8391552c-c8f7-53ed-8132-b85a65ea562f with scrape type 2
2026-03-28 12:10:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8391552c-c8f7-53ed-8132-b85a65ea562f, identifier: LS28867
2026-03-28 12:10:21 [auto1.it] INFO: Found listing with ID: UU51056
2026-03-28 12:10:21 [auto1.it] INFO: Found listing with ID: WK74495
2026-03-28 12:10:21 [auto1.it] INFO: Found listing with ID: HP26181
2026-03-28 12:10:21 [auto1.it] INFO: Found listing with ID: FR70206
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR70206%27 HTTP/1.1" 200 None
2026-03-28 12:10:21 [auto1.it] INFO: Scrape type for FR70206: 2
2026-03-28 12:10:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66f392db-30b0-541e-93ea-e05c58a83b35 with identifier: FR70206
2026-03-28 12:10:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66f392db-30b0-541e-93ea-e05c58a83b35 with scrape type 2
2026-03-28 12:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66f392db-30b0-541e-93ea-e05c58a83b35 with scrape type 2
2026-03-28 12:10:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 66f392db-30b0-541e-93ea-e05c58a83b35, identifier: FR70206
2026-03-28 12:10:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8391552c-c8f7-53ed-8132-b85a65ea562f with identifier: LS28867
2026-03-28 12:10:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8391552c-c8f7-53ed-8132-b85a65ea562f with identifier: LS28867
2026-03-28 12:10:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8391552c-c8f7-53ed-8132-b85a65ea562f with identifier: LS28867 to the API
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:22:43Z',
 'fuel_type': 'diesel',
 'id': '8391552c-c8f7-53ed-8132-b85a65ea562f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS28867',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 84526,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-06',
 'seller_name': None,
 'title': 'Renault Megane 1.6 dCi Energy GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2017}
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS28867%27 HTTP/1.1" 200 None
2026-03-28 12:10:21 [auto1.it] INFO: Saving data for LS28867: {'auction_closing_time': 1774714963.0, 'created_time': 1774613198.024813, 'last_price_update_time': 1774699821.448243}
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LS28867') HTTP/1.1" 204 0
2026-03-28 12:10:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 66f392db-30b0-541e-93ea-e05c58a83b35 with identifier: FR70206
2026-03-28 12:10:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 66f392db-30b0-541e-93ea-e05c58a83b35 with identifier: FR70206
2026-03-28 12:10:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 66f392db-30b0-541e-93ea-e05c58a83b35 with identifier: FR70206 to the API
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:44:14Z',
 'fuel_type': 'diesel',
 'id': '66f392db-30b0-541e-93ea-e05c58a83b35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR70206',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Koleos',
 'odometer': 203548,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-29',
 'seller_name': None,
 'title': 'Renault Koleos 2.0 dCi Energy Intens 4x4',
 'transmission': 'automatic',
 'trim': 'Intens 4x4',
 'year': 2018}
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR70206%27 HTTP/1.1" 200 None
2026-03-28 12:10:21 [auto1.it] INFO: Saving data for FR70206: {'auction_closing_time': 1774716254.0, 'created_time': 1774613201.533557, 'last_price_update_time': 1774699821.715669}
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FR70206') HTTP/1.1" 204 0
2026-03-28 12:10:21 [auto1.it] INFO: Found listing with ID: TZ47815
2026-03-28 12:10:21 [auto1.it] INFO: Found listing with ID: RL97939
2026-03-28 12:10:21 [auto1.it] INFO: Found listing with ID: SC91639
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC91639%27 HTTP/1.1" 200 None
2026-03-28 12:10:21 [auto1.it] INFO: Scrape type for SC91639: 2
2026-03-28 12:10:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29547f06-5805-54cd-8209-d9680f49ce38 with identifier: SC91639
2026-03-28 12:10:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29547f06-5805-54cd-8209-d9680f49ce38 with scrape type 2
2026-03-28 12:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29547f06-5805-54cd-8209-d9680f49ce38 with scrape type 2
2026-03-28 12:10:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 29547f06-5805-54cd-8209-d9680f49ce38, identifier: SC91639
2026-03-28 12:10:21 [auto1.it] INFO: Found listing with ID: UX09906
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX09906%27 HTTP/1.1" 200 None
2026-03-28 12:10:21 [auto1.it] INFO: Scrape type for UX09906: 2
2026-03-28 12:10:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b540a6eb-06b4-54f9-bfda-23221ed47eba with identifier: UX09906
2026-03-28 12:10:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b540a6eb-06b4-54f9-bfda-23221ed47eba with scrape type 2
2026-03-28 12:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b540a6eb-06b4-54f9-bfda-23221ed47eba with scrape type 2
2026-03-28 12:10:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b540a6eb-06b4-54f9-bfda-23221ed47eba, identifier: UX09906
2026-03-28 12:10:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 29547f06-5805-54cd-8209-d9680f49ce38 with identifier: SC91639
2026-03-28 12:10:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 29547f06-5805-54cd-8209-d9680f49ce38 with identifier: SC91639
2026-03-28 12:10:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 29547f06-5805-54cd-8209-d9680f49ce38 with identifier: SC91639 to the API
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:07:57Z',
 'fuel_type': 'diesel',
 'id': '29547f06-5805-54cd-8209-d9680f49ce38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC91639',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 268609,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-29',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 2.0 JTDM Distinctive',
 'transmission': 'manual',
 'trim': 'Distinctive',
 'year': 2015}
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC91639%27 HTTP/1.1" 200 None
2026-03-28 12:10:22 [auto1.it] INFO: Saving data for SC91639: {'auction_closing_time': 1774714077.0, 'created_time': 1774613182.37485, 'last_price_update_time': 1774699822.256837}
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SC91639') HTTP/1.1" 204 0
2026-03-28 12:10:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b540a6eb-06b4-54f9-bfda-23221ed47eba with identifier: UX09906
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-28 12:10:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:10:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b540a6eb-06b4-54f9-bfda-23221ed47eba with identifier: UX09906
2026-03-28 12:10:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b540a6eb-06b4-54f9-bfda-23221ed47eba with identifier: UX09906 to the API
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:06:57Z',
 'fuel_type': 'electro',
 'id': 'b540a6eb-06b4-54f9-bfda-23221ed47eba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX09906',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 10656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-09',
 'seller_name': None,
 'title': 'Smart fortwo electric drive 60 kW edition racingrey Prime EQ',
 'transmission': 'automatic',
 'trim': 'edition racingrey Prime EQ',
 'year': 2022}
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX09906%27 HTTP/1.1" 200 None
2026-03-28 12:10:22 [auto1.it] INFO: Saving data for UX09906: {'auction_closing_time': 1774714017.0, 'created_time': 1774613194.994891, 'last_price_update_time': 1774699822.739613}
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UX09906') HTTP/1.1" 204 0
2026-03-28 12:10:22 [auto1.it] INFO: Found listing with ID: RM66107
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM66107%27 HTTP/1.1" 200 None
2026-03-28 12:10:22 [auto1.it] INFO: Scrape type for RM66107: 2
2026-03-28 12:10:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f250df4-e841-53c0-ad18-00a88fca7fb1 with identifier: RM66107
2026-03-28 12:10:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f250df4-e841-53c0-ad18-00a88fca7fb1 with scrape type 2
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f250df4-e841-53c0-ad18-00a88fca7fb1 with scrape type 2
2026-03-28 12:10:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8f250df4-e841-53c0-ad18-00a88fca7fb1, identifier: RM66107
2026-03-28 12:10:22 [auto1.it] INFO: Found listing with ID: EZ75087
2026-03-28 12:10:22 [auto1.it] INFO: Found listing with ID: YZ06369
2026-03-28 12:10:22 [auto1.it] INFO: Found listing with ID: MJ31103
2026-03-28 12:10:22 [auto1.it] INFO: Found listing with ID: HJ18951
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HJ18951%27 HTTP/1.1" 200 None
2026-03-28 12:10:22 [auto1.it] INFO: Scrape type for HJ18951: 2
2026-03-28 12:10:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a8f9e47-5307-5024-8c0a-4fc1919ec1b0 with identifier: HJ18951
2026-03-28 12:10:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a8f9e47-5307-5024-8c0a-4fc1919ec1b0 with scrape type 2
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a8f9e47-5307-5024-8c0a-4fc1919ec1b0 with scrape type 2
2026-03-28 12:10:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1a8f9e47-5307-5024-8c0a-4fc1919ec1b0, identifier: HJ18951
2026-03-28 12:10:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8f250df4-e841-53c0-ad18-00a88fca7fb1 with identifier: RM66107
2026-03-28 12:10:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8f250df4-e841-53c0-ad18-00a88fca7fb1 with identifier: RM66107
2026-03-28 12:10:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8f250df4-e841-53c0-ad18-00a88fca7fb1 with identifier: RM66107 to the API
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:58:11Z',
 'fuel_type': 'diesel',
 'id': '8f250df4-e841-53c0-ad18-00a88fca7fb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM66107',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 114488,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-30',
 'seller_name': None,
 'title': 'Fiat 500L 1.3 M-Jet Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2017}
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM66107%27 HTTP/1.1" 200 None
2026-03-28 12:10:23 [auto1.it] INFO: Saving data for RM66107: {'auction_closing_time': 1774717091.0, 'created_time': 1774613197.278123, 'last_price_update_time': 1774699823.276468}
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RM66107') HTTP/1.1" 204 0
2026-03-28 12:10:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1a8f9e47-5307-5024-8c0a-4fc1919ec1b0 with identifier: HJ18951
2026-03-28 12:10:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1a8f9e47-5307-5024-8c0a-4fc1919ec1b0 with identifier: HJ18951
2026-03-28 12:10:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1a8f9e47-5307-5024-8c0a-4fc1919ec1b0 with identifier: HJ18951 to the API
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-28T16:35:56Z',
 'fuel_type': 'hybrid',
 'id': '1a8f9e47-5307-5024-8c0a-4fc1919ec1b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ18951',
 'listing': 'auction',
 'make': 'MG',
 'model': 'ZS',
 'odometer': 37282,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-01-23',
 'seller_name': None,
 'title': 'MG ZS 1.5 T-GDI Plug-in Hybrid Luxury',
 'transmission': 'automatic',
 'trim': 'Luxury',
 'year': 2025}
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HJ18951%27 HTTP/1.1" 200 None
2026-03-28 12:10:23 [auto1.it] INFO: Saving data for HJ18951: {'auction_closing_time': 1774715756.0, 'created_time': 1774613183.293701, 'last_price_update_time': 1774699823.55106}
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HJ18951') HTTP/1.1" 204 0
2026-03-28 12:10:23 [auto1.it] INFO: Found listing with ID: KH81346
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KH81346%27 HTTP/1.1" 200 None
2026-03-28 12:10:23 [auto1.it] INFO: Scrape type for KH81346: 2
2026-03-28 12:10:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3adc7f6-1f0f-5fa8-85a3-00b82429f5a9 with identifier: KH81346
2026-03-28 12:10:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3adc7f6-1f0f-5fa8-85a3-00b82429f5a9 with scrape type 2
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3adc7f6-1f0f-5fa8-85a3-00b82429f5a9 with scrape type 2
2026-03-28 12:10:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d3adc7f6-1f0f-5fa8-85a3-00b82429f5a9, identifier: KH81346
2026-03-28 12:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:23 [auto1.it] INFO: Found listing with ID: YM27608
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM27608%27 HTTP/1.1" 200 None
2026-03-28 12:10:23 [auto1.it] INFO: Scrape type for YM27608: 2
2026-03-28 12:10:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02cab264-eb0e-536b-b445-25c489e852e0 with identifier: YM27608
2026-03-28 12:10:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02cab264-eb0e-536b-b445-25c489e852e0 with scrape type 2
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02cab264-eb0e-536b-b445-25c489e852e0 with scrape type 2
2026-03-28 12:10:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 02cab264-eb0e-536b-b445-25c489e852e0, identifier: YM27608
2026-03-28 12:10:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d3adc7f6-1f0f-5fa8-85a3-00b82429f5a9 with identifier: KH81346
2026-03-28 12:10:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d3adc7f6-1f0f-5fa8-85a3-00b82429f5a9 with identifier: KH81346
2026-03-28 12:10:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d3adc7f6-1f0f-5fa8-85a3-00b82429f5a9 with identifier: KH81346 to the API
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 55,
 'expiration_date': '2026-03-28T16:06:28Z',
 'fuel_type': 'petrol',
 'id': 'd3adc7f6-1f0f-5fa8-85a3-00b82429f5a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH81346',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Seicento',
 'odometer': 27335,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-11-15',
 'seller_name': None,
 'title': 'Fiat Seicento 1.1 Actual',
 'transmission': 'manual',
 'trim': 'Actual',
 'year': 2004}
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KH81346%27 HTTP/1.1" 200 None
2026-03-28 12:10:24 [auto1.it] INFO: Saving data for KH81346: {'auction_closing_time': 1774713988.0, 'created_time': 1774613192.506495, 'last_price_update_time': 1774699824.03523}
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KH81346') HTTP/1.1" 204 0
2026-03-28 12:10:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 02cab264-eb0e-536b-b445-25c489e852e0 with identifier: YM27608
2026-03-28 12:10:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 02cab264-eb0e-536b-b445-25c489e852e0 with identifier: YM27608
2026-03-28 12:10:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 02cab264-eb0e-536b-b445-25c489e852e0 with identifier: YM27608 to the API
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 179,
 'expiration_date': '2026-03-28T16:17:53Z',
 'fuel_type': 'electro',
 'id': '02cab264-eb0e-536b-b445-25c489e852e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM27608',
 'listing': 'auction',
 'make': 'MG',
 'model': 'Marvel R',
 'odometer': 24234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-28',
 'seller_name': None,
 'title': 'MG Marvel R electric drive 132 kW Luxury',
 'transmission': 'automatic',
 'trim': 'Luxury',
 'year': 2021}
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM27608%27 HTTP/1.1" 200 None
2026-03-28 12:10:24 [auto1.it] INFO: Saving data for YM27608: {'auction_closing_time': 1774714673.0, 'created_time': 1774613189.751238, 'last_price_update_time': 1774699824.316438}
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YM27608') HTTP/1.1" 204 0
2026-03-28 12:10:24 [auto1.it] INFO: Found listing with ID: HY77897
2026-03-28 12:10:24 [auto1.it] INFO: Found listing with ID: AZ70503
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ70503%27 HTTP/1.1" 200 None
2026-03-28 12:10:24 [auto1.it] INFO: Scrape type for AZ70503: 2
2026-03-28 12:10:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b2bc54f-f454-5f83-86e1-ac4996bfd7fa with identifier: AZ70503
2026-03-28 12:10:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b2bc54f-f454-5f83-86e1-ac4996bfd7fa with scrape type 2
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b2bc54f-f454-5f83-86e1-ac4996bfd7fa with scrape type 2
2026-03-28 12:10:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9b2bc54f-f454-5f83-86e1-ac4996bfd7fa, identifier: AZ70503
2026-03-28 12:10:24 [auto1.it] INFO: Found listing with ID: ZF27085
2026-03-28 12:10:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9b2bc54f-f454-5f83-86e1-ac4996bfd7fa with identifier: AZ70503
2026-03-28 12:10:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9b2bc54f-f454-5f83-86e1-ac4996bfd7fa with identifier: AZ70503
2026-03-28 12:10:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9b2bc54f-f454-5f83-86e1-ac4996bfd7fa with identifier: AZ70503 to the API
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:14:32Z',
 'fuel_type': 'diesel',
 'id': '9b2bc54f-f454-5f83-86e1-ac4996bfd7fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ70503',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 140264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-06',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 D4 Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2018}
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ70503%27 HTTP/1.1" 200 None
2026-03-28 12:10:24 [auto1.it] INFO: Saving data for AZ70503: {'auction_closing_time': 1774714472.0, 'created_time': 1774101974.597057, 'last_price_update_time': 1774699824.714713}
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AZ70503') HTTP/1.1" 204 0
2026-03-28 12:10:24 [auto1.it] INFO: Found listing with ID: YS71318
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS71318%27 HTTP/1.1" 200 None
2026-03-28 12:10:24 [auto1.it] INFO: Scrape type for YS71318: 0
2026-03-28 12:10:24 [auto1.it] INFO: Found listing with ID: NR25924
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR25924%27 HTTP/1.1" 200 None
2026-03-28 12:10:24 [auto1.it] INFO: Scrape type for NR25924: 2
2026-03-28 12:10:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2ed63b0-c494-5e54-b595-842b6dd4a36b with identifier: NR25924
2026-03-28 12:10:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2ed63b0-c494-5e54-b595-842b6dd4a36b with scrape type 2
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2ed63b0-c494-5e54-b595-842b6dd4a36b with scrape type 2
2026-03-28 12:10:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e2ed63b0-c494-5e54-b595-842b6dd4a36b, identifier: NR25924
2026-03-28 12:10:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e2ed63b0-c494-5e54-b595-842b6dd4a36b with identifier: NR25924
2026-03-28 12:10:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e2ed63b0-c494-5e54-b595-842b6dd4a36b with identifier: NR25924
2026-03-28 12:10:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e2ed63b0-c494-5e54-b595-842b6dd4a36b with identifier: NR25924 to the API
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:41:08Z',
 'fuel_type': 'petrol',
 'id': 'e2ed63b0-c494-5e54-b595-842b6dd4a36b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR25924',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 103649,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-03',
 'seller_name': None,
 'title': 'Fiat 500X 1.4 Turbo Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2015}
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR25924%27 HTTP/1.1" 200 None
2026-03-28 12:10:25 [auto1.it] INFO: Saving data for NR25924: {'auction_closing_time': 1774716068.0, 'created_time': 1774613183.981103, 'last_price_update_time': 1774699825.135375}
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NR25924') HTTP/1.1" 204 0
2026-03-28 12:10:25 [auto1.it] INFO: Channel: 24h | Page: 76 | totalHits: 3675 | hits on page: 40
2026-03-28 12:10:25 [auto1.it] INFO: Found listing with ID: ND31908
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ND31908%27 HTTP/1.1" 200 None
2026-03-28 12:10:25 [auto1.it] INFO: Scrape type for ND31908: 2
2026-03-28 12:10:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30bef070-cfed-5a36-b827-c2a090c6f1b3 with identifier: ND31908
2026-03-28 12:10:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30bef070-cfed-5a36-b827-c2a090c6f1b3 with scrape type 2
2026-03-28 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30bef070-cfed-5a36-b827-c2a090c6f1b3 with scrape type 2
2026-03-28 12:10:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 30bef070-cfed-5a36-b827-c2a090c6f1b3, identifier: ND31908
2026-03-28 12:10:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 30bef070-cfed-5a36-b827-c2a090c6f1b3 with identifier: ND31908
2026-03-28 12:10:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 30bef070-cfed-5a36-b827-c2a090c6f1b3 with identifier: ND31908
2026-03-28 12:10:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 30bef070-cfed-5a36-b827-c2a090c6f1b3 with identifier: ND31908 to the API
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:14:01Z',
 'fuel_type': 'petrol',
 'id': '30bef070-cfed-5a36-b827-c2a090c6f1b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND31908',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 189749,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-31',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2008}
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ND31908%27 HTTP/1.1" 200 None
2026-03-28 12:10:25 [auto1.it] INFO: Saving data for ND31908: {'auction_closing_time': 1774714441.0, 'created_time': 1772308838.37094, 'last_price_update_time': 1774699825.609229}
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ND31908') HTTP/1.1" 204 0
2026-03-28 12:10:25 [auto1.it] INFO: Found listing with ID: LZ33850
2026-03-28 12:10:25 [auto1.it] INFO: Found listing with ID: UZ86540
2026-03-28 12:10:25 [auto1.it] INFO: Found listing with ID: MU30420
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU30420%27 HTTP/1.1" 200 None
2026-03-28 12:10:25 [auto1.it] INFO: Scrape type for MU30420: 2
2026-03-28 12:10:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c3a7a8c-1722-555c-b03c-a0633103195d with identifier: MU30420
2026-03-28 12:10:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c3a7a8c-1722-555c-b03c-a0633103195d with scrape type 2
2026-03-28 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c3a7a8c-1722-555c-b03c-a0633103195d with scrape type 2
2026-03-28 12:10:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4c3a7a8c-1722-555c-b03c-a0633103195d, identifier: MU30420
2026-03-28 12:10:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:25 [auto1.it] INFO: Found listing with ID: ER28485
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ER28485%27 HTTP/1.1" 200 None
2026-03-28 12:10:25 [auto1.it] INFO: Scrape type for ER28485: 2
2026-03-28 12:10:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12503720-a8cb-5e6a-963b-9eb0c73183c6 with identifier: ER28485
2026-03-28 12:10:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12503720-a8cb-5e6a-963b-9eb0c73183c6 with scrape type 2
2026-03-28 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12503720-a8cb-5e6a-963b-9eb0c73183c6 with scrape type 2
2026-03-28 12:10:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 12503720-a8cb-5e6a-963b-9eb0c73183c6, identifier: ER28485
2026-03-28 12:10:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4c3a7a8c-1722-555c-b03c-a0633103195d with identifier: MU30420
2026-03-28 12:10:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4c3a7a8c-1722-555c-b03c-a0633103195d with identifier: MU30420
2026-03-28 12:10:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4c3a7a8c-1722-555c-b03c-a0633103195d with identifier: MU30420 to the API
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:33:21Z',
 'fuel_type': 'diesel',
 'id': '4c3a7a8c-1722-555c-b03c-a0633103195d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU30420',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 180486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-16',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion',
 'transmission': 'manual',
 'trim': 'Sport & Style 4Motion',
 'year': 2012}
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU30420%27 HTTP/1.1" 200 None
2026-03-28 12:10:26 [auto1.it] INFO: Saving data for MU30420: {'auction_closing_time': 1774715601.0, 'created_time': 1774613301.300186, 'last_price_update_time': 1774699826.111886}
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MU30420') HTTP/1.1" 204 0
2026-03-28 12:10:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 12503720-a8cb-5e6a-963b-9eb0c73183c6 with identifier: ER28485
2026-03-28 12:10:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 12503720-a8cb-5e6a-963b-9eb0c73183c6 with identifier: ER28485
2026-03-28 12:10:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 12503720-a8cb-5e6a-963b-9eb0c73183c6 with identifier: ER28485 to the API
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 69,
 'expiration_date': '2026-03-28T16:04:12Z',
 'fuel_type': 'petrol',
 'id': '12503720-a8cb-5e6a-963b-9eb0c73183c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER28485',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 31636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-27',
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid',
 'transmission': 'manual',
 'trim': '',
 'year': 2023}
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ER28485%27 HTTP/1.1" 200 None
2026-03-28 12:10:26 [auto1.it] INFO: Saving data for ER28485: {'auction_closing_time': 1774713852.0, 'created_time': 1774613193.225112, 'last_price_update_time': 1774699826.403914}
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ER28485') HTTP/1.1" 204 0
2026-03-28 12:10:26 [auto1.it] INFO: Found listing with ID: EJ86461
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EJ86461%27 HTTP/1.1" 200 None
2026-03-28 12:10:26 [auto1.it] INFO: Scrape type for EJ86461: 2
2026-03-28 12:10:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 357c16c5-2e39-5b04-bc97-992e67af150f with identifier: EJ86461
2026-03-28 12:10:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 357c16c5-2e39-5b04-bc97-992e67af150f with scrape type 2
2026-03-28 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 357c16c5-2e39-5b04-bc97-992e67af150f with scrape type 2
2026-03-28 12:10:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 357c16c5-2e39-5b04-bc97-992e67af150f, identifier: EJ86461
2026-03-28 12:10:26 [auto1.it] INFO: Found listing with ID: RP23530
2026-03-28 12:10:26 [auto1.it] INFO: Found listing with ID: HU57894
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU57894%27 HTTP/1.1" 200 None
2026-03-28 12:10:26 [auto1.it] INFO: Scrape type for HU57894: 2
2026-03-28 12:10:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b49996b1-b269-5215-92cc-817fc9f78190 with identifier: HU57894
2026-03-28 12:10:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b49996b1-b269-5215-92cc-817fc9f78190 with scrape type 2
2026-03-28 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b49996b1-b269-5215-92cc-817fc9f78190 with scrape type 2
2026-03-28 12:10:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b49996b1-b269-5215-92cc-817fc9f78190, identifier: HU57894
2026-03-28 12:10:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 357c16c5-2e39-5b04-bc97-992e67af150f with identifier: EJ86461
2026-03-28 12:10:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 357c16c5-2e39-5b04-bc97-992e67af150f with identifier: EJ86461
2026-03-28 12:10:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 357c16c5-2e39-5b04-bc97-992e67af150f with identifier: EJ86461 to the API
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:50:53Z',
 'fuel_type': 'petrol',
 'id': '357c16c5-2e39-5b04-bc97-992e67af150f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ86461',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 99112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-29',
 'seller_name': None,
 'title': 'Fiat Punto 1.2 Street',
 'transmission': 'manual',
 'trim': 'Street',
 'year': 2018}
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EJ86461%27 HTTP/1.1" 200 None
2026-03-28 12:10:26 [auto1.it] INFO: Saving data for EJ86461: {'auction_closing_time': 1774716653.0, 'created_time': 1774613306.906229, 'last_price_update_time': 1774699826.969109}
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EJ86461') HTTP/1.1" 204 0
2026-03-28 12:10:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b49996b1-b269-5215-92cc-817fc9f78190 with identifier: HU57894
2026-03-28 12:10:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b49996b1-b269-5215-92cc-817fc9f78190 with identifier: HU57894
2026-03-28 12:10:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b49996b1-b269-5215-92cc-817fc9f78190 with identifier: HU57894 to the API
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:35:18Z',
 'fuel_type': 'diesel',
 'id': 'b49996b1-b269-5215-92cc-817fc9f78190',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU57894',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Sedici',
 'odometer': 261929,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-01-17',
 'seller_name': None,
 'title': 'Fiat Sedici 1.9 JTD Multijet Emotion 4x4',
 'transmission': 'manual',
 'trim': 'Multijet Emotion 4x4',
 'year': 2007}
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU57894%27 HTTP/1.1" 200 None
2026-03-28 12:10:27 [auto1.it] INFO: Saving data for HU57894: {'auction_closing_time': 1774715718.0, 'created_time': 1774613192.125337, 'last_price_update_time': 1774699827.260455}
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HU57894') HTTP/1.1" 204 0
2026-03-28 12:10:27 [auto1.it] INFO: Found listing with ID: WA22264
2026-03-28 12:10:27 [auto1.it] INFO: Found listing with ID: ZL89240
2026-03-28 12:10:27 [auto1.it] INFO: Found listing with ID: SZ00349
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SZ00349%27 HTTP/1.1" 200 None
2026-03-28 12:10:27 [auto1.it] INFO: Scrape type for SZ00349: 2
2026-03-28 12:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ec7d430-a34a-5719-99cb-ee8b3465aaba with identifier: SZ00349
2026-03-28 12:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ec7d430-a34a-5719-99cb-ee8b3465aaba with scrape type 2
2026-03-28 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ec7d430-a34a-5719-99cb-ee8b3465aaba with scrape type 2
2026-03-28 12:10:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6ec7d430-a34a-5719-99cb-ee8b3465aaba, identifier: SZ00349
2026-03-28 12:10:27 [auto1.it] INFO: Found listing with ID: SN99997
2026-03-28 12:10:27 [auto1.it] INFO: Found listing with ID: BE36594
2026-03-28 12:10:27 [auto1.it] INFO: Found listing with ID: UR23669
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR23669%27 HTTP/1.1" 200 None
2026-03-28 12:10:27 [auto1.it] INFO: Scrape type for UR23669: 2
2026-03-28 12:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc45f004-43b6-5e27-829f-56cff7ce88de with identifier: UR23669
2026-03-28 12:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc45f004-43b6-5e27-829f-56cff7ce88de with scrape type 2
2026-03-28 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc45f004-43b6-5e27-829f-56cff7ce88de with scrape type 2
2026-03-28 12:10:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fc45f004-43b6-5e27-829f-56cff7ce88de, identifier: UR23669
2026-03-28 12:10:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6ec7d430-a34a-5719-99cb-ee8b3465aaba with identifier: SZ00349
2026-03-28 12:10:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6ec7d430-a34a-5719-99cb-ee8b3465aaba with identifier: SZ00349
2026-03-28 12:10:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6ec7d430-a34a-5719-99cb-ee8b3465aaba with identifier: SZ00349 to the API
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:38:10Z',
 'fuel_type': 'diesel',
 'id': '6ec7d430-a34a-5719-99cb-ee8b3465aaba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ00349',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Freemont',
 'odometer': 171146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-29',
 'seller_name': None,
 'title': 'Fiat Freemont 2.0 Multijet Cross AWD',
 'transmission': 'automatic',
 'trim': 'Cross AWD',
 'year': 2016}
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SZ00349%27 HTTP/1.1" 200 None
2026-03-28 12:10:27 [auto1.it] INFO: Saving data for SZ00349: {'auction_closing_time': 1774715890.0, 'created_time': 1774613299.807021, 'last_price_update_time': 1774699827.783361}
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SZ00349') HTTP/1.1" 204 0
2026-03-28 12:10:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fc45f004-43b6-5e27-829f-56cff7ce88de with identifier: UR23669
2026-03-28 12:10:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fc45f004-43b6-5e27-829f-56cff7ce88de with identifier: UR23669
2026-03-28 12:10:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fc45f004-43b6-5e27-829f-56cff7ce88de with identifier: UR23669 to the API
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:41:12Z',
 'fuel_type': 'diesel',
 'id': 'fc45f004-43b6-5e27-829f-56cff7ce88de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR23669',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 84146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-28',
 'seller_name': None,
 'title': 'Fiat 500L 1.3 M-Jet Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2019}
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR23669%27 HTTP/1.1" 200 None
2026-03-28 12:10:28 [auto1.it] INFO: Saving data for UR23669: {'auction_closing_time': 1774716072.0, 'created_time': 1774343188.254872, 'last_price_update_time': 1774699828.160301}
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UR23669') HTTP/1.1" 204 0
2026-03-28 12:10:28 [auto1.it] INFO: Found listing with ID: LN67507
2026-03-28 12:10:28 [auto1.it] INFO: Found listing with ID: KR37794
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR37794%27 HTTP/1.1" 200 None
2026-03-28 12:10:28 [auto1.it] INFO: Scrape type for KR37794: 2
2026-03-28 12:10:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 907f8f6b-b197-5f34-84e2-16a45167bfa6 with identifier: KR37794
2026-03-28 12:10:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 907f8f6b-b197-5f34-84e2-16a45167bfa6 with scrape type 2
2026-03-28 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 907f8f6b-b197-5f34-84e2-16a45167bfa6 with scrape type 2
2026-03-28 12:10:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 907f8f6b-b197-5f34-84e2-16a45167bfa6, identifier: KR37794
2026-03-28 12:10:28 [auto1.it] INFO: Found listing with ID: LR45419
2026-03-28 12:10:28 [auto1.it] INFO: Found listing with ID: XX72461
2026-03-28 12:10:28 [auto1.it] INFO: Found listing with ID: RE68635
2026-03-28 12:10:28 [auto1.it] INFO: Found listing with ID: JT08977
2026-03-28 12:10:28 [auto1.it] INFO: Found listing with ID: HC78741
2026-03-28 12:10:28 [auto1.it] INFO: Found listing with ID: XC90090
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC90090%27 HTTP/1.1" 200 None
2026-03-28 12:10:28 [auto1.it] INFO: Scrape type for XC90090: 0
2026-03-28 12:10:28 [auto1.it] INFO: Found listing with ID: JK13765
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK13765%27 HTTP/1.1" 200 None
2026-03-28 12:10:28 [auto1.it] INFO: Scrape type for JK13765: 2
2026-03-28 12:10:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b329b892-3213-59a1-a997-cb02bea70c90 with identifier: JK13765
2026-03-28 12:10:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b329b892-3213-59a1-a997-cb02bea70c90 with scrape type 2
2026-03-28 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b329b892-3213-59a1-a997-cb02bea70c90 with scrape type 2
2026-03-28 12:10:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b329b892-3213-59a1-a997-cb02bea70c90, identifier: JK13765
2026-03-28 12:10:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 907f8f6b-b197-5f34-84e2-16a45167bfa6 with identifier: KR37794
2026-03-28 12:10:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 907f8f6b-b197-5f34-84e2-16a45167bfa6 with identifier: KR37794
2026-03-28 12:10:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 907f8f6b-b197-5f34-84e2-16a45167bfa6 with identifier: KR37794 to the API
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-28T16:11:05Z',
 'fuel_type': 'diesel',
 'id': '907f8f6b-b197-5f34-84e2-16a45167bfa6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR37794',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 154984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-09',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro Competition',
 'transmission': 'automatic',
 'trim': 'quattro Competition',
 'year': 2017}
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR37794%27 HTTP/1.1" 200 None
2026-03-28 12:10:28 [auto1.it] INFO: Saving data for KR37794: {'auction_closing_time': 1774714265.0, 'created_time': 1773136627.237718, 'last_price_update_time': 1774699828.675329}
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KR37794') HTTP/1.1" 204 0
2026-03-28 12:10:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b329b892-3213-59a1-a997-cb02bea70c90 with identifier: JK13765
2026-03-28 12:10:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b329b892-3213-59a1-a997-cb02bea70c90 with identifier: JK13765
2026-03-28 12:10:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b329b892-3213-59a1-a997-cb02bea70c90 with identifier: JK13765 to the API
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 106,
 'expiration_date': '2026-03-28T16:41:29Z',
 'fuel_type': 'petrol',
 'id': 'b329b892-3213-59a1-a997-cb02bea70c90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK13765',
 'listing': 'auction',
 'make': 'MG',
 'model': 'ZS',
 'odometer': 62539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-28',
 'seller_name': None,
 'title': 'MG ZS 1.5 VTi Luxury',
 'transmission': 'manual',
 'trim': 'Luxury',
 'year': 2024}
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK13765%27 HTTP/1.1" 200 None
2026-03-28 12:10:28 [auto1.it] INFO: Saving data for JK13765: {'auction_closing_time': 1774716089.0, 'created_time': 1774613212.580199, 'last_price_update_time': 1774699828.957129}
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JK13765') HTTP/1.1" 204 0
2026-03-28 12:10:28 [auto1.it] INFO: Found listing with ID: NF87616
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF87616%27 HTTP/1.1" 200 None
2026-03-28 12:10:28 [auto1.it] INFO: Scrape type for NF87616: 2
2026-03-28 12:10:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25caa08c-a786-50c0-98ef-1bc238a46cdd with identifier: NF87616
2026-03-28 12:10:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25caa08c-a786-50c0-98ef-1bc238a46cdd with scrape type 2
2026-03-28 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25caa08c-a786-50c0-98ef-1bc238a46cdd with scrape type 2
2026-03-28 12:10:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 25caa08c-a786-50c0-98ef-1bc238a46cdd, identifier: NF87616
2026-03-28 12:10:29 [auto1.it] INFO: Found listing with ID: UD57618
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD57618%27 HTTP/1.1" 200 None
2026-03-28 12:10:29 [auto1.it] INFO: Scrape type for UD57618: 2
2026-03-28 12:10:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ac48006-ee28-5bf5-be3d-e1e37b5bb299 with identifier: UD57618
2026-03-28 12:10:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ac48006-ee28-5bf5-be3d-e1e37b5bb299 with scrape type 2
2026-03-28 12:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ac48006-ee28-5bf5-be3d-e1e37b5bb299 with scrape type 2
2026-03-28 12:10:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3ac48006-ee28-5bf5-be3d-e1e37b5bb299, identifier: UD57618
2026-03-28 12:10:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 25caa08c-a786-50c0-98ef-1bc238a46cdd with identifier: NF87616
2026-03-28 12:10:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 25caa08c-a786-50c0-98ef-1bc238a46cdd with identifier: NF87616
2026-03-28 12:10:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 25caa08c-a786-50c0-98ef-1bc238a46cdd with identifier: NF87616 to the API
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:36:41Z',
 'fuel_type': 'diesel',
 'id': '25caa08c-a786-50c0-98ef-1bc238a46cdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF87616',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 198556,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-06',
 'seller_name': None,
 'title': 'Renault Kadjar 1.5 dCi Energy Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2017}
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF87616%27 HTTP/1.1" 200 None
2026-03-28 12:10:29 [auto1.it] INFO: Saving data for NF87616: {'auction_closing_time': 1774715801.0, 'created_time': 1774613222.063205, 'last_price_update_time': 1774699829.442711}
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NF87616') HTTP/1.1" 204 0
2026-03-28 12:10:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3ac48006-ee28-5bf5-be3d-e1e37b5bb299 with identifier: UD57618
2026-03-28 12:10:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3ac48006-ee28-5bf5-be3d-e1e37b5bb299 with identifier: UD57618
2026-03-28 12:10:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3ac48006-ee28-5bf5-be3d-e1e37b5bb299 with identifier: UD57618 to the API
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:49:50Z',
 'fuel_type': 'diesel',
 'id': '3ac48006-ee28-5bf5-be3d-e1e37b5bb299',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD57618',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 318409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-30',
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
 'transmission': 'manual',
 'trim': 'Limited FWD',
 'year': 2016}
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD57618%27 HTTP/1.1" 200 None
2026-03-28 12:10:29 [auto1.it] INFO: Saving data for UD57618: {'auction_closing_time': 1774716590.0, 'created_time': 1774613247.996585, 'last_price_update_time': 1774699829.820317}
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UD57618') HTTP/1.1" 204 0
2026-03-28 12:10:29 [auto1.it] INFO: Found listing with ID: GC68104
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC68104%27 HTTP/1.1" 200 None
2026-03-28 12:10:29 [auto1.it] INFO: Scrape type for GC68104: 2
2026-03-28 12:10:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 284bfaa8-3918-5be5-b937-806942ddca7c with identifier: GC68104
2026-03-28 12:10:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 284bfaa8-3918-5be5-b937-806942ddca7c with scrape type 2
2026-03-28 12:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 284bfaa8-3918-5be5-b937-806942ddca7c with scrape type 2
2026-03-28 12:10:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 284bfaa8-3918-5be5-b937-806942ddca7c, identifier: GC68104
2026-03-28 12:10:29 [auto1.it] INFO: Found listing with ID: FH81414
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FH81414%27 HTTP/1.1" 200 None
2026-03-28 12:10:29 [auto1.it] INFO: Scrape type for FH81414: 2
2026-03-28 12:10:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c1b6ff5-c7c6-58a3-b4bf-f81e7d96a411 with identifier: FH81414
2026-03-28 12:10:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c1b6ff5-c7c6-58a3-b4bf-f81e7d96a411 with scrape type 2
2026-03-28 12:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c1b6ff5-c7c6-58a3-b4bf-f81e7d96a411 with scrape type 2
2026-03-28 12:10:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4c1b6ff5-c7c6-58a3-b4bf-f81e7d96a411, identifier: FH81414
2026-03-28 12:10:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 284bfaa8-3918-5be5-b937-806942ddca7c with identifier: GC68104
2026-03-28 12:10:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 284bfaa8-3918-5be5-b937-806942ddca7c with identifier: GC68104
2026-03-28 12:10:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 284bfaa8-3918-5be5-b937-806942ddca7c with identifier: GC68104 to the API
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 162,
 'expiration_date': '2026-03-28T16:25:54Z',
 'fuel_type': 'petrol',
 'id': '284bfaa8-3918-5be5-b937-806942ddca7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC68104',
 'listing': 'auction',
 'make': 'MG',
 'model': 'HS',
 'odometer': 59706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-29',
 'seller_name': None,
 'title': 'MG HS 1.5 Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2024}
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC68104%27 HTTP/1.1" 200 None
2026-03-28 12:10:30 [auto1.it] INFO: Saving data for GC68104: {'auction_closing_time': 1774715154.0, 'created_time': 1774613221.161601, 'last_price_update_time': 1774699830.350703}
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GC68104') HTTP/1.1" 204 0
2026-03-28 12:10:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4c1b6ff5-c7c6-58a3-b4bf-f81e7d96a411 with identifier: FH81414
2026-03-28 12:10:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4c1b6ff5-c7c6-58a3-b4bf-f81e7d96a411 with identifier: FH81414
2026-03-28 12:10:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4c1b6ff5-c7c6-58a3-b4bf-f81e7d96a411 with identifier: FH81414 to the API
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:43:28Z',
 'fuel_type': 'petrol',
 'id': '4c1b6ff5-c7c6-58a3-b4bf-f81e7d96a411',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH81414',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 107297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-10-08',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2006}
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FH81414%27 HTTP/1.1" 200 None
2026-03-28 12:10:30 [auto1.it] INFO: Saving data for FH81414: {'auction_closing_time': 1774716208.0, 'created_time': 1774613278.036453, 'last_price_update_time': 1774699830.621025}
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FH81414') HTTP/1.1" 204 0
2026-03-28 12:10:30 [auto1.it] INFO: Found listing with ID: AE34833
2026-03-28 12:10:30 [auto1.it] INFO: Found listing with ID: HS60673
2026-03-28 12:10:30 [auto1.it] INFO: Found listing with ID: BT26363
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT26363%27 HTTP/1.1" 200 None
2026-03-28 12:10:30 [auto1.it] INFO: Scrape type for BT26363: 2
2026-03-28 12:10:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34fce799-edf7-5988-8b66-ebb10d9618c1 with identifier: BT26363
2026-03-28 12:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34fce799-edf7-5988-8b66-ebb10d9618c1 with scrape type 2
2026-03-28 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34fce799-edf7-5988-8b66-ebb10d9618c1 with scrape type 2
2026-03-28 12:10:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 34fce799-edf7-5988-8b66-ebb10d9618c1, identifier: BT26363
2026-03-28 12:10:30 [auto1.it] INFO: Found listing with ID: GT75186
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT75186%27 HTTP/1.1" 200 None
2026-03-28 12:10:30 [auto1.it] INFO: Scrape type for GT75186: 2
2026-03-28 12:10:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3780a79-c791-515e-a828-fc33aa2fa859 with identifier: GT75186
2026-03-28 12:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3780a79-c791-515e-a828-fc33aa2fa859 with scrape type 2
2026-03-28 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3780a79-c791-515e-a828-fc33aa2fa859 with scrape type 2
2026-03-28 12:10:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a3780a79-c791-515e-a828-fc33aa2fa859, identifier: GT75186
2026-03-28 12:10:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 34fce799-edf7-5988-8b66-ebb10d9618c1 with identifier: BT26363
2026-03-28 12:10:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 34fce799-edf7-5988-8b66-ebb10d9618c1 with identifier: BT26363
2026-03-28 12:10:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 34fce799-edf7-5988-8b66-ebb10d9618c1 with identifier: BT26363 to the API
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 162,
 'expiration_date': '2026-03-28T16:57:46Z',
 'fuel_type': 'petrol',
 'id': '34fce799-edf7-5988-8b66-ebb10d9618c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT26363',
 'listing': 'auction',
 'make': 'MG',
 'model': 'HS',
 'odometer': 53981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-29',
 'seller_name': None,
 'title': 'MG HS 1.5 Luxury',
 'transmission': 'automatic',
 'trim': 'Luxury',
 'year': 2024}
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT26363%27 HTTP/1.1" 200 None
2026-03-28 12:10:31 [auto1.it] INFO: Saving data for BT26363: {'auction_closing_time': 1774717066.0, 'created_time': 1774613288.266474, 'last_price_update_time': 1774699831.381205}
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BT26363') HTTP/1.1" 204 0
2026-03-28 12:10:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a3780a79-c791-515e-a828-fc33aa2fa859 with identifier: GT75186
2026-03-28 12:10:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a3780a79-c791-515e-a828-fc33aa2fa859 with identifier: GT75186
2026-03-28 12:10:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a3780a79-c791-515e-a828-fc33aa2fa859 with identifier: GT75186 to the API
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 162,
 'expiration_date': '2026-03-28T16:29:39Z',
 'fuel_type': 'petrol',
 'id': 'a3780a79-c791-515e-a828-fc33aa2fa859',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT75186',
 'listing': 'auction',
 'make': 'MG',
 'model': 'HS',
 'odometer': 30094,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-08-29',
 'seller_name': None,
 'title': 'MG HS 1.5 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2024}
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT75186%27 HTTP/1.1" 200 None
2026-03-28 12:10:31 [auto1.it] INFO: Saving data for GT75186: {'auction_closing_time': 1774715379.0, 'created_time': 1774613220.413344, 'last_price_update_time': 1774699831.6774}
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GT75186') HTTP/1.1" 204 0
2026-03-28 12:10:31 [auto1.it] INFO: Found listing with ID: RT50500
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT50500%27 HTTP/1.1" 200 None
2026-03-28 12:10:31 [auto1.it] INFO: Scrape type for RT50500: 2
2026-03-28 12:10:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c99ef70-89f2-5483-862d-af9d4aeb79c3 with identifier: RT50500
2026-03-28 12:10:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c99ef70-89f2-5483-862d-af9d4aeb79c3 with scrape type 2
2026-03-28 12:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c99ef70-89f2-5483-862d-af9d4aeb79c3 with scrape type 2
2026-03-28 12:10:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2c99ef70-89f2-5483-862d-af9d4aeb79c3, identifier: RT50500
2026-03-28 12:10:31 [auto1.it] INFO: Found listing with ID: ZY33580
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY33580%27 HTTP/1.1" 200 None
2026-03-28 12:10:31 [auto1.it] INFO: Scrape type for ZY33580: 2
2026-03-28 12:10:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 152b26fe-c8b9-5c21-95a3-89d060237078 with identifier: ZY33580
2026-03-28 12:10:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 152b26fe-c8b9-5c21-95a3-89d060237078 with scrape type 2
2026-03-28 12:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 152b26fe-c8b9-5c21-95a3-89d060237078 with scrape type 2
2026-03-28 12:10:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 152b26fe-c8b9-5c21-95a3-89d060237078, identifier: ZY33580
2026-03-28 12:10:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2c99ef70-89f2-5483-862d-af9d4aeb79c3 with identifier: RT50500
2026-03-28 12:10:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2c99ef70-89f2-5483-862d-af9d4aeb79c3 with identifier: RT50500
2026-03-28 12:10:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2c99ef70-89f2-5483-862d-af9d4aeb79c3 with identifier: RT50500 to the API
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:21:40Z',
 'fuel_type': 'diesel',
 'id': '2c99ef70-89f2-5483-862d-af9d4aeb79c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT50500',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 133350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-30',
 'seller_name': None,
 'title': 'Nissan X-Trail 1.7 dCi Acenta 4x4',
 'transmission': 'manual',
 'trim': 'Acenta 4x4',
 'year': 2020}
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT50500%27 HTTP/1.1" 200 None
2026-03-28 12:10:32 [auto1.it] INFO: Saving data for RT50500: {'auction_closing_time': 1774714900.0, 'created_time': 1774613308.282424, 'last_price_update_time': 1774699832.172843}
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RT50500') HTTP/1.1" 204 0
2026-03-28 12:10:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 152b26fe-c8b9-5c21-95a3-89d060237078 with identifier: ZY33580
2026-03-28 12:10:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 152b26fe-c8b9-5c21-95a3-89d060237078 with identifier: ZY33580
2026-03-28 12:10:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 152b26fe-c8b9-5c21-95a3-89d060237078 with identifier: ZY33580 to the API
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-28T16:36:10Z',
 'fuel_type': 'diesel',
 'id': '152b26fe-c8b9-5c21-95a3-89d060237078',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY33580',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 303438,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-12',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2006}
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY33580%27 HTTP/1.1" 200 None
2026-03-28 12:10:32 [auto1.it] INFO: Saving data for ZY33580: {'auction_closing_time': 1774715770.0, 'created_time': 1774300014.258969, 'last_price_update_time': 1774699832.514247}
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZY33580') HTTP/1.1" 204 0
2026-03-28 12:10:32 [auto1.it] INFO: Found listing with ID: JM39933
2026-03-28 12:10:32 [auto1.it] INFO: Found listing with ID: ZL56801
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL56801%27 HTTP/1.1" 200 None
2026-03-28 12:10:32 [auto1.it] INFO: Scrape type for ZL56801: 0
2026-03-28 12:10:32 [auto1.it] INFO: Found listing with ID: UU49973
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU49973%27 HTTP/1.1" 200 None
2026-03-28 12:10:32 [auto1.it] INFO: Scrape type for UU49973: 2
2026-03-28 12:10:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac8d85e1-1d87-5ccf-b611-26f469c25025 with identifier: UU49973
2026-03-28 12:10:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac8d85e1-1d87-5ccf-b611-26f469c25025 with scrape type 2
2026-03-28 12:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac8d85e1-1d87-5ccf-b611-26f469c25025 with scrape type 2
2026-03-28 12:10:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ac8d85e1-1d87-5ccf-b611-26f469c25025, identifier: UU49973
2026-03-28 12:10:32 [auto1.it] INFO: Found listing with ID: FX08227
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX08227%27 HTTP/1.1" 200 None
2026-03-28 12:10:32 [auto1.it] INFO: Scrape type for FX08227: 2
2026-03-28 12:10:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d43b6c0e-8ac2-590c-9774-de446b261816 with identifier: FX08227
2026-03-28 12:10:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d43b6c0e-8ac2-590c-9774-de446b261816 with scrape type 2
2026-03-28 12:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d43b6c0e-8ac2-590c-9774-de446b261816 with scrape type 2
2026-03-28 12:10:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d43b6c0e-8ac2-590c-9774-de446b261816, identifier: FX08227
2026-03-28 12:10:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ac8d85e1-1d87-5ccf-b611-26f469c25025 with identifier: UU49973
2026-03-28 12:10:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ac8d85e1-1d87-5ccf-b611-26f469c25025 with identifier: UU49973
2026-03-28 12:10:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ac8d85e1-1d87-5ccf-b611-26f469c25025 with identifier: UU49973 to the API
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 400,
 'expiration_date': '2026-03-28T16:09:14Z',
 'fuel_type': 'petrol',
 'id': 'ac8d85e1-1d87-5ccf-b611-26f469c25025',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU49973',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'RS 3',
 'odometer': 40517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-30',
 'seller_name': None,
 'title': 'Audi RS 3 2.5 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2022}
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU49973%27 HTTP/1.1" 200 None
2026-03-28 12:10:33 [auto1.it] INFO: Saving data for UU49973: {'auction_closing_time': 1774714154.0, 'created_time': 1774613302.127587, 'last_price_update_time': 1774699833.016998}
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UU49973') HTTP/1.1" 204 0
2026-03-28 12:10:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d43b6c0e-8ac2-590c-9774-de446b261816 with identifier: FX08227
2026-03-28 12:10:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d43b6c0e-8ac2-590c-9774-de446b261816 with identifier: FX08227
2026-03-28 12:10:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d43b6c0e-8ac2-590c-9774-de446b261816 with identifier: FX08227 to the API
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:50:11Z',
 'fuel_type': 'petrol',
 'id': 'd43b6c0e-8ac2-590c-9774-de446b261816',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX08227',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 100793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-26',
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2019}
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX08227%27 HTTP/1.1" 200 None
2026-03-28 12:10:33 [auto1.it] INFO: Saving data for FX08227: {'auction_closing_time': 1774716611.0, 'created_time': 1774343148.171454, 'last_price_update_time': 1774699833.4384}
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FX08227') HTTP/1.1" 204 0
2026-03-28 12:10:33 [auto1.it] INFO: Found listing with ID: CR75802
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR75802%27 HTTP/1.1" 200 None
2026-03-28 12:10:33 [auto1.it] INFO: Scrape type for CR75802: 2
2026-03-28 12:10:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6be0a616-7fb3-56b5-8e12-cd6fc483ba73 with identifier: CR75802
2026-03-28 12:10:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6be0a616-7fb3-56b5-8e12-cd6fc483ba73 with scrape type 2
2026-03-28 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6be0a616-7fb3-56b5-8e12-cd6fc483ba73 with scrape type 2
2026-03-28 12:10:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6be0a616-7fb3-56b5-8e12-cd6fc483ba73, identifier: CR75802
2026-03-28 12:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:33 [auto1.it] INFO: Found listing with ID: EC01464
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC01464%27 HTTP/1.1" 200 None
2026-03-28 12:10:33 [auto1.it] INFO: Scrape type for EC01464: 2
2026-03-28 12:10:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57a03216-cb22-5753-8142-c679ada39084 with identifier: EC01464
2026-03-28 12:10:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57a03216-cb22-5753-8142-c679ada39084 with scrape type 2
2026-03-28 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57a03216-cb22-5753-8142-c679ada39084 with scrape type 2
2026-03-28 12:10:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 57a03216-cb22-5753-8142-c679ada39084, identifier: EC01464
2026-03-28 12:10:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6be0a616-7fb3-56b5-8e12-cd6fc483ba73 with identifier: CR75802
2026-03-28 12:10:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6be0a616-7fb3-56b5-8e12-cd6fc483ba73 with identifier: CR75802
2026-03-28 12:10:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6be0a616-7fb3-56b5-8e12-cd6fc483ba73 with identifier: CR75802 to the API
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:36:13Z',
 'fuel_type': 'diesel',
 'id': '6be0a616-7fb3-56b5-8e12-cd6fc483ba73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR75802',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 78415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-30',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2020}
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR75802%27 HTTP/1.1" 200 None
2026-03-28 12:10:33 [auto1.it] INFO: Saving data for CR75802: {'auction_closing_time': 1774715773.0, 'created_time': 1774613225.748184, 'last_price_update_time': 1774699833.913195}
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CR75802') HTTP/1.1" 204 0
2026-03-28 12:10:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 57a03216-cb22-5753-8142-c679ada39084 with identifier: EC01464
2026-03-28 12:10:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 57a03216-cb22-5753-8142-c679ada39084 with identifier: EC01464
2026-03-28 12:10:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 57a03216-cb22-5753-8142-c679ada39084 with identifier: EC01464 to the API
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 106,
 'expiration_date': '2026-03-28T16:00:17Z',
 'fuel_type': 'petrol',
 'id': '57a03216-cb22-5753-8142-c679ada39084',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC01464',
 'listing': 'auction',
 'make': 'MG',
 'model': 'ZS',
 'odometer': 61208,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-28',
 'seller_name': None,
 'title': 'MG ZS 1.5 VTi Luxury',
 'transmission': 'manual',
 'trim': 'Luxury',
 'year': 2024}
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC01464%27 HTTP/1.1" 200 None
2026-03-28 12:10:34 [auto1.it] INFO: Saving data for EC01464: {'auction_closing_time': 1774713617.0, 'created_time': 1774613220.763146, 'last_price_update_time': 1774699834.206239}
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EC01464') HTTP/1.1" 204 0
2026-03-28 12:10:34 [auto1.it] INFO: Found listing with ID: XM40674
2026-03-28 12:10:34 [auto1.it] INFO: Found listing with ID: GY05881
2026-03-28 12:10:34 [auto1.it] INFO: Found listing with ID: BS72965
2026-03-28 12:10:34 [auto1.it] INFO: Found listing with ID: HR54236
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR54236%27 HTTP/1.1" 200 None
2026-03-28 12:10:34 [auto1.it] INFO: Scrape type for HR54236: 2
2026-03-28 12:10:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98675376-3b1e-5280-8a15-2612d88d816d with identifier: HR54236
2026-03-28 12:10:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98675376-3b1e-5280-8a15-2612d88d816d with scrape type 2
2026-03-28 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98675376-3b1e-5280-8a15-2612d88d816d with scrape type 2
2026-03-28 12:10:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 98675376-3b1e-5280-8a15-2612d88d816d, identifier: HR54236
2026-03-28 12:10:34 [auto1.it] INFO: Found listing with ID: CZ44875
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ44875%27 HTTP/1.1" 200 None
2026-03-28 12:10:34 [auto1.it] INFO: Scrape type for CZ44875: 2
2026-03-28 12:10:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6112100-e1f2-59a7-abfd-d07a07b998ed with identifier: CZ44875
2026-03-28 12:10:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6112100-e1f2-59a7-abfd-d07a07b998ed with scrape type 2
2026-03-28 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6112100-e1f2-59a7-abfd-d07a07b998ed with scrape type 2
2026-03-28 12:10:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b6112100-e1f2-59a7-abfd-d07a07b998ed, identifier: CZ44875
2026-03-28 12:10:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 98675376-3b1e-5280-8a15-2612d88d816d with identifier: HR54236
2026-03-28 12:10:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 98675376-3b1e-5280-8a15-2612d88d816d with identifier: HR54236
2026-03-28 12:10:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 98675376-3b1e-5280-8a15-2612d88d816d with identifier: HR54236 to the API
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:19:24Z',
 'fuel_type': 'diesel',
 'id': '98675376-3b1e-5280-8a15-2612d88d816d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR54236',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Transporter',
 'odometer': 212557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-10',
 'seller_name': None,
 'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten FWD',
 'transmission': 'automatic',
 'trim': 'Kasten FWD',
 'year': 2020}
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR54236%27 HTTP/1.1" 200 None
2026-03-28 12:10:34 [auto1.it] INFO: Saving data for HR54236: {'auction_closing_time': 1774714764.0, 'created_time': 1774613275.767829, 'last_price_update_time': 1774699834.708913}
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HR54236') HTTP/1.1" 204 0
2026-03-28 12:10:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b6112100-e1f2-59a7-abfd-d07a07b998ed with identifier: CZ44875
2026-03-28 12:10:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b6112100-e1f2-59a7-abfd-d07a07b998ed with identifier: CZ44875
2026-03-28 12:10:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b6112100-e1f2-59a7-abfd-d07a07b998ed with identifier: CZ44875 to the API
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:50:53Z',
 'fuel_type': 'diesel',
 'id': 'b6112100-e1f2-59a7-abfd-d07a07b998ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ44875',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 267476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-23',
 'seller_name': None,
 'title': 'Fiat Doblo 1.9 JTD Multijet Active',
 'transmission': 'manual',
 'trim': 'Multijet Active',
 'year': 2008}
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ44875%27 HTTP/1.1" 200 None
2026-03-28 12:10:34 [auto1.it] INFO: Saving data for CZ44875: {'auction_closing_time': 1774716653.0, 'created_time': 1774613282.565816, 'last_price_update_time': 1774699834.995555}
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CZ44875') HTTP/1.1" 204 0
2026-03-28 12:10:35 [auto1.it] INFO: Found listing with ID: UD54750
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD54750%27 HTTP/1.1" 200 None
2026-03-28 12:10:35 [auto1.it] INFO: Scrape type for UD54750: 2
2026-03-28 12:10:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ea605b3-eccc-58f9-932b-e8adbaeec803 with identifier: UD54750
2026-03-28 12:10:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ea605b3-eccc-58f9-932b-e8adbaeec803 with scrape type 2
2026-03-28 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ea605b3-eccc-58f9-932b-e8adbaeec803 with scrape type 2
2026-03-28 12:10:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7ea605b3-eccc-58f9-932b-e8adbaeec803, identifier: UD54750
2026-03-28 12:10:35 [auto1.it] INFO: Found listing with ID: ZN99189
2026-03-28 12:10:35 [auto1.it] INFO: Found listing with ID: NG22695
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG22695%27 HTTP/1.1" 200 None
2026-03-28 12:10:35 [auto1.it] INFO: Scrape type for NG22695: 2
2026-03-28 12:10:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e86dc03-605f-55dd-800e-fad697142fc8 with identifier: NG22695
2026-03-28 12:10:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e86dc03-605f-55dd-800e-fad697142fc8 with scrape type 2
2026-03-28 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e86dc03-605f-55dd-800e-fad697142fc8 with scrape type 2
2026-03-28 12:10:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2e86dc03-605f-55dd-800e-fad697142fc8, identifier: NG22695
2026-03-28 12:10:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7ea605b3-eccc-58f9-932b-e8adbaeec803 with identifier: UD54750
2026-03-28 12:10:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7ea605b3-eccc-58f9-932b-e8adbaeec803 with identifier: UD54750
2026-03-28 12:10:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7ea605b3-eccc-58f9-932b-e8adbaeec803 with identifier: UD54750 to the API
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:49:50Z',
 'fuel_type': 'diesel',
 'id': '7ea605b3-eccc-58f9-932b-e8adbaeec803',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD54750',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 45566,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-04',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Business Line BlueMotion Tech.',
 'transmission': 'manual',
 'trim': 'Business Line BlueMotion Tech.',
 'year': 2019}
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD54750%27 HTTP/1.1" 200 None
2026-03-28 12:10:35 [auto1.it] INFO: Saving data for UD54750: {'auction_closing_time': 1774716590.0, 'created_time': 1772224742.182684, 'last_price_update_time': 1774699835.536086}
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UD54750') HTTP/1.1" 204 0
2026-03-28 12:10:35 [auto1.it] INFO: Channel: 24h | Page: 77 | totalHits: 3676 | hits on page: 40
2026-03-28 12:10:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2e86dc03-605f-55dd-800e-fad697142fc8 with identifier: NG22695
2026-03-28 12:10:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2e86dc03-605f-55dd-800e-fad697142fc8 with identifier: NG22695
2026-03-28 12:10:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2e86dc03-605f-55dd-800e-fad697142fc8 with identifier: NG22695 to the API
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 106,
 'expiration_date': '2026-03-28T16:26:45Z',
 'fuel_type': 'petrol',
 'id': '2e86dc03-605f-55dd-800e-fad697142fc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG22695',
 'listing': 'auction',
 'make': 'MG',
 'model': 'ZS',
 'odometer': 13236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-04-21',
 'seller_name': None,
 'title': 'MG ZS 1.5 VTi Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2025}
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG22695%27 HTTP/1.1" 200 None
2026-03-28 12:10:35 [auto1.it] INFO: Saving data for NG22695: {'auction_closing_time': 1774715205.0, 'created_time': 1774613302.867859, 'last_price_update_time': 1774699835.87515}
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NG22695') HTTP/1.1" 204 0
2026-03-28 12:10:35 [auto1.it] INFO: Found listing with ID: AK67199
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK67199%27 HTTP/1.1" 200 None
2026-03-28 12:10:35 [auto1.it] INFO: Scrape type for AK67199: 2
2026-03-28 12:10:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8b4e6b5-278d-559c-8f65-2af8cff2aea3 with identifier: AK67199
2026-03-28 12:10:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8b4e6b5-278d-559c-8f65-2af8cff2aea3 with scrape type 2
2026-03-28 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8b4e6b5-278d-559c-8f65-2af8cff2aea3 with scrape type 2
2026-03-28 12:10:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f8b4e6b5-278d-559c-8f65-2af8cff2aea3, identifier: AK67199
2026-03-28 12:10:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f8b4e6b5-278d-559c-8f65-2af8cff2aea3 with identifier: AK67199
2026-03-28 12:10:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f8b4e6b5-278d-559c-8f65-2af8cff2aea3 with identifier: AK67199
2026-03-28 12:10:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f8b4e6b5-278d-559c-8f65-2af8cff2aea3 with identifier: AK67199 to the API
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:37:56Z',
 'fuel_type': 'diesel',
 'id': 'f8b4e6b5-278d-559c-8f65-2af8cff2aea3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK67199',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 245437,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-20',
 'seller_name': None,
 'title': 'BMW X3 sDrive 18d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK67199%27 HTTP/1.1" 200 None
2026-03-28 12:10:36 [auto1.it] INFO: Saving data for AK67199: {'auction_closing_time': 1774715876.0, 'created_time': 1774613260.266066, 'last_price_update_time': 1774699836.26904}
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AK67199') HTTP/1.1" 204 0
2026-03-28 12:10:36 [auto1.it] INFO: Found listing with ID: PW94940
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW94940%27 HTTP/1.1" 200 None
2026-03-28 12:10:36 [auto1.it] INFO: Scrape type for PW94940: 2
2026-03-28 12:10:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a52abdb-9cec-51d1-ac45-ce519158c844 with identifier: PW94940
2026-03-28 12:10:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a52abdb-9cec-51d1-ac45-ce519158c844 with scrape type 2
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a52abdb-9cec-51d1-ac45-ce519158c844 with scrape type 2
2026-03-28 12:10:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3a52abdb-9cec-51d1-ac45-ce519158c844, identifier: PW94940
2026-03-28 12:10:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:36 [auto1.it] INFO: Found listing with ID: WL39771
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL39771%27 HTTP/1.1" 200 None
2026-03-28 12:10:36 [auto1.it] INFO: Scrape type for WL39771: 2
2026-03-28 12:10:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c609a635-e0ff-5944-a449-af4baf1d9178 with identifier: WL39771
2026-03-28 12:10:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c609a635-e0ff-5944-a449-af4baf1d9178 with scrape type 2
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c609a635-e0ff-5944-a449-af4baf1d9178 with scrape type 2
2026-03-28 12:10:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c609a635-e0ff-5944-a449-af4baf1d9178, identifier: WL39771
2026-03-28 12:10:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3a52abdb-9cec-51d1-ac45-ce519158c844 with identifier: PW94940
2026-03-28 12:10:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3a52abdb-9cec-51d1-ac45-ce519158c844 with identifier: PW94940
2026-03-28 12:10:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3a52abdb-9cec-51d1-ac45-ce519158c844 with identifier: PW94940 to the API
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:57:54Z',
 'fuel_type': 'petrol',
 'id': '3a52abdb-9cec-51d1-ac45-ce519158c844',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW94940',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 66863,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-29',
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2020}
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW94940%27 HTTP/1.1" 200 None
2026-03-28 12:10:36 [auto1.it] INFO: Saving data for PW94940: {'auction_closing_time': 1774717074.0, 'created_time': 1774613263.116386, 'last_price_update_time': 1774699836.866972}
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PW94940') HTTP/1.1" 204 0
2026-03-28 12:10:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c609a635-e0ff-5944-a449-af4baf1d9178 with identifier: WL39771
2026-03-28 12:10:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c609a635-e0ff-5944-a449-af4baf1d9178 with identifier: WL39771
2026-03-28 12:10:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c609a635-e0ff-5944-a449-af4baf1d9178 with identifier: WL39771 to the API
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:04:13Z',
 'fuel_type': 'diesel',
 'id': 'c609a635-e0ff-5944-a449-af4baf1d9178',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL39771',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40 Cross Country',
 'odometer': 137876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-30',
 'seller_name': None,
 'title': 'Volvo V40 Cross Country 2.0 D2 Plus',
 'transmission': 'manual',
 'trim': 'Plus',
 'year': 2018}
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL39771%27 HTTP/1.1" 200 None
2026-03-28 12:10:37 [auto1.it] INFO: Saving data for WL39771: {'auction_closing_time': 1774713853.0, 'created_time': 1774613242.797942, 'last_price_update_time': 1774699837.130525}
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WL39771') HTTP/1.1" 204 0
2026-03-28 12:10:37 [auto1.it] INFO: Found listing with ID: PK39445
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK39445%27 HTTP/1.1" 200 None
2026-03-28 12:10:37 [auto1.it] INFO: Scrape type for PK39445: 0
2026-03-28 12:10:37 [auto1.it] INFO: Found listing with ID: HC25835
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC25835%27 HTTP/1.1" 200 None
2026-03-28 12:10:37 [auto1.it] INFO: Scrape type for HC25835: 2
2026-03-28 12:10:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06823f8e-99cc-5980-8627-e0f7b1c42b53 with identifier: HC25835
2026-03-28 12:10:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06823f8e-99cc-5980-8627-e0f7b1c42b53 with scrape type 2
2026-03-28 12:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06823f8e-99cc-5980-8627-e0f7b1c42b53 with scrape type 2
2026-03-28 12:10:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 06823f8e-99cc-5980-8627-e0f7b1c42b53, identifier: HC25835
2026-03-28 12:10:37 [auto1.it] INFO: Found listing with ID: KW57065
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW57065%27 HTTP/1.1" 200 None
2026-03-28 12:10:37 [auto1.it] INFO: Scrape type for KW57065: 2
2026-03-28 12:10:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1bb8b92-aa50-50a1-b0dd-6e46e3cf4aa6 with identifier: KW57065
2026-03-28 12:10:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1bb8b92-aa50-50a1-b0dd-6e46e3cf4aa6 with scrape type 2
2026-03-28 12:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1bb8b92-aa50-50a1-b0dd-6e46e3cf4aa6 with scrape type 2
2026-03-28 12:10:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b1bb8b92-aa50-50a1-b0dd-6e46e3cf4aa6, identifier: KW57065
2026-03-28 12:10:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 06823f8e-99cc-5980-8627-e0f7b1c42b53 with identifier: HC25835
2026-03-28 12:10:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 06823f8e-99cc-5980-8627-e0f7b1c42b53 with identifier: HC25835
2026-03-28 12:10:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 06823f8e-99cc-5980-8627-e0f7b1c42b53 with identifier: HC25835 to the API
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:52:02Z',
 'fuel_type': 'diesel',
 'id': '06823f8e-99cc-5980-8627-e0f7b1c42b53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC25835',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Caravelle',
 'odometer': 221458,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-04',
 'seller_name': None,
 'title': 'Volkswagen T6 Caravelle 2.0 TDI Comfortline lang',
 'transmission': 'automatic',
 'trim': 'Comfortline lang',
 'year': 2018}
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC25835%27 HTTP/1.1" 200 None
2026-03-28 12:10:37 [auto1.it] INFO: Saving data for HC25835: {'auction_closing_time': 1774716722.0, 'created_time': 1774613275.397071, 'last_price_update_time': 1774699837.661702}
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HC25835') HTTP/1.1" 204 0
2026-03-28 12:10:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b1bb8b92-aa50-50a1-b0dd-6e46e3cf4aa6 with identifier: KW57065
2026-03-28 12:10:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b1bb8b92-aa50-50a1-b0dd-6e46e3cf4aa6 with identifier: KW57065
2026-03-28 12:10:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b1bb8b92-aa50-50a1-b0dd-6e46e3cf4aa6 with identifier: KW57065 to the API
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-28T16:29:24Z',
 'fuel_type': 'hybrid',
 'id': 'b1bb8b92-aa50-50a1-b0dd-6e46e3cf4aa6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW57065',
 'listing': 'auction',
 'make': 'Lexus',
 'model': 'NX-Serie',
 'odometer': 245501,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-08',
 'seller_name': None,
 'title': 'Lexus NX-Serie NX 300h E-Four Executive Line',
 'transmission': 'automatic',
 'trim': 'E-Four Executive Line',
 'year': 2016}
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW57065%27 HTTP/1.1" 200 None
2026-03-28 12:10:37 [auto1.it] INFO: Saving data for KW57065: {'auction_closing_time': 1774715364.0, 'created_time': 1774613236.266069, 'last_price_update_time': 1774699837.94207}
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KW57065') HTTP/1.1" 204 0
2026-03-28 12:10:37 [auto1.it] INFO: Found listing with ID: DC04279
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC04279%27 HTTP/1.1" 200 None
2026-03-28 12:10:37 [auto1.it] INFO: Scrape type for DC04279: 2
2026-03-28 12:10:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a407654f-e08a-5c20-86b6-7dd5d14a2231 with identifier: DC04279
2026-03-28 12:10:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a407654f-e08a-5c20-86b6-7dd5d14a2231 with scrape type 2
2026-03-28 12:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a407654f-e08a-5c20-86b6-7dd5d14a2231 with scrape type 2
2026-03-28 12:10:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a407654f-e08a-5c20-86b6-7dd5d14a2231, identifier: DC04279
2026-03-28 12:10:38 [auto1.it] INFO: Found listing with ID: MW60739
2026-03-28 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW60739%27 HTTP/1.1" 200 None
2026-03-28 12:10:38 [auto1.it] INFO: Scrape type for MW60739: 2
2026-03-28 12:10:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba88ecef-fc32-5d23-ae8f-c5250ce1c3ac with identifier: MW60739
2026-03-28 12:10:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba88ecef-fc32-5d23-ae8f-c5250ce1c3ac with scrape type 2
2026-03-28 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba88ecef-fc32-5d23-ae8f-c5250ce1c3ac with scrape type 2
2026-03-28 12:10:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ba88ecef-fc32-5d23-ae8f-c5250ce1c3ac, identifier: MW60739
2026-03-28 12:10:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a407654f-e08a-5c20-86b6-7dd5d14a2231 with identifier: DC04279
2026-03-28 12:10:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a407654f-e08a-5c20-86b6-7dd5d14a2231 with identifier: DC04279
2026-03-28 12:10:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a407654f-e08a-5c20-86b6-7dd5d14a2231 with identifier: DC04279 to the API
2026-03-28 12:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:45:24Z',
 'fuel_type': 'petrol',
 'id': 'a407654f-e08a-5c20-86b6-7dd5d14a2231',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC04279',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Modus',
 'odometer': 87095,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-30',
 'seller_name': None,
 'title': 'Renault Modus 1.2 YAHOO!',
 'transmission': 'manual',
 'trim': 'YAHOO!',
 'year': 2011}
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC04279%27 HTTP/1.1" 200 None
2026-03-28 12:10:39 [auto1.it] INFO: Saving data for DC04279: {'auction_closing_time': 1774716324.0, 'created_time': 1774613275.030356, 'last_price_update_time': 1774699839.118869}
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DC04279') HTTP/1.1" 204 0
2026-03-28 12:10:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ba88ecef-fc32-5d23-ae8f-c5250ce1c3ac with identifier: MW60739
2026-03-28 12:10:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ba88ecef-fc32-5d23-ae8f-c5250ce1c3ac with identifier: MW60739
2026-03-28 12:10:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ba88ecef-fc32-5d23-ae8f-c5250ce1c3ac with identifier: MW60739 to the API
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:56:08Z',
 'fuel_type': 'petrol',
 'id': 'ba88ecef-fc32-5d23-ae8f-c5250ce1c3ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW60739',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 71186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-25',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2014}
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW60739%27 HTTP/1.1" 200 None
2026-03-28 12:10:39 [auto1.it] INFO: Saving data for MW60739: {'auction_closing_time': 1774716968.0, 'created_time': 1772224532.770899, 'last_price_update_time': 1774699839.394682}
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MW60739') HTTP/1.1" 204 0
2026-03-28 12:10:39 [auto1.it] INFO: Found listing with ID: BH96807
2026-03-28 12:10:39 [auto1.it] INFO: Found listing with ID: WP65731
2026-03-28 12:10:39 [auto1.it] INFO: Found listing with ID: EH79430
2026-03-28 12:10:39 [auto1.it] INFO: Found listing with ID: YB05417
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB05417%27 HTTP/1.1" 200 None
2026-03-28 12:10:39 [auto1.it] INFO: Scrape type for YB05417: 2
2026-03-28 12:10:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 356594d2-b293-5ed3-a8c2-78b4271785bb with identifier: YB05417
2026-03-28 12:10:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 356594d2-b293-5ed3-a8c2-78b4271785bb with scrape type 2
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 356594d2-b293-5ed3-a8c2-78b4271785bb with scrape type 2
2026-03-28 12:10:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 356594d2-b293-5ed3-a8c2-78b4271785bb, identifier: YB05417
2026-03-28 12:10:39 [auto1.it] INFO: Found listing with ID: LM66726
2026-03-28 12:10:39 [auto1.it] INFO: Found listing with ID: GT76958
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT76958%27 HTTP/1.1" 200 None
2026-03-28 12:10:39 [auto1.it] INFO: Scrape type for GT76958: 2
2026-03-28 12:10:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb18b683-9be3-5866-83fe-e4ad3d744eef with identifier: GT76958
2026-03-28 12:10:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb18b683-9be3-5866-83fe-e4ad3d744eef with scrape type 2
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb18b683-9be3-5866-83fe-e4ad3d744eef with scrape type 2
2026-03-28 12:10:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: eb18b683-9be3-5866-83fe-e4ad3d744eef, identifier: GT76958
2026-03-28 12:10:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 356594d2-b293-5ed3-a8c2-78b4271785bb with identifier: YB05417
2026-03-28 12:10:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 356594d2-b293-5ed3-a8c2-78b4271785bb with identifier: YB05417
2026-03-28 12:10:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 356594d2-b293-5ed3-a8c2-78b4271785bb with identifier: YB05417 to the API
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:16:39Z',
 'fuel_type': 'diesel',
 'id': '356594d2-b293-5ed3-a8c2-78b4271785bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB05417',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 212306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-29',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 dCi Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2012}
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB05417%27 HTTP/1.1" 200 None
2026-03-28 12:10:39 [auto1.it] INFO: Saving data for YB05417: {'auction_closing_time': 1774714599.0, 'created_time': 1774613258.553288, 'last_price_update_time': 1774699839.913227}
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YB05417') HTTP/1.1" 204 0
2026-03-28 12:10:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: eb18b683-9be3-5866-83fe-e4ad3d744eef with identifier: GT76958
2026-03-28 12:10:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: eb18b683-9be3-5866-83fe-e4ad3d744eef with identifier: GT76958
2026-03-28 12:10:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: eb18b683-9be3-5866-83fe-e4ad3d744eef with identifier: GT76958 to the API
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:43:48Z',
 'fuel_type': 'diesel',
 'id': 'eb18b683-9be3-5866-83fe-e4ad3d744eef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT76958',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 246845,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-10',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT76958%27 HTTP/1.1" 200 None
2026-03-28 12:10:40 [auto1.it] INFO: Saving data for GT76958: {'auction_closing_time': 1774716228.0, 'created_time': 1774343173.478889, 'last_price_update_time': 1774699840.292479}
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GT76958') HTTP/1.1" 204 0
2026-03-28 12:10:40 [auto1.it] INFO: Found listing with ID: XB62766
2026-03-28 12:10:40 [auto1.it] INFO: Found listing with ID: CN31542
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN31542%27 HTTP/1.1" 200 None
2026-03-28 12:10:40 [auto1.it] INFO: Scrape type for CN31542: 2
2026-03-28 12:10:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67f69e12-e652-5955-b870-a657b54b8bad with identifier: CN31542
2026-03-28 12:10:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67f69e12-e652-5955-b870-a657b54b8bad with scrape type 2
2026-03-28 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67f69e12-e652-5955-b870-a657b54b8bad with scrape type 2
2026-03-28 12:10:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 67f69e12-e652-5955-b870-a657b54b8bad, identifier: CN31542
2026-03-28 12:10:40 [auto1.it] INFO: Found listing with ID: VA29565
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VA29565%27 HTTP/1.1" 200 None
2026-03-28 12:10:40 [auto1.it] INFO: Scrape type for VA29565: 2
2026-03-28 12:10:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64285844-56ed-5c3a-b334-30939f1c58b4 with identifier: VA29565
2026-03-28 12:10:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64285844-56ed-5c3a-b334-30939f1c58b4 with scrape type 2
2026-03-28 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64285844-56ed-5c3a-b334-30939f1c58b4 with scrape type 2
2026-03-28 12:10:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 64285844-56ed-5c3a-b334-30939f1c58b4, identifier: VA29565
2026-03-28 12:10:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 67f69e12-e652-5955-b870-a657b54b8bad with identifier: CN31542
2026-03-28 12:10:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 67f69e12-e652-5955-b870-a657b54b8bad with identifier: CN31542
2026-03-28 12:10:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 67f69e12-e652-5955-b870-a657b54b8bad with identifier: CN31542 to the API
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:12:03Z',
 'fuel_type': 'diesel',
 'id': '67f69e12-e652-5955-b870-a657b54b8bad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN31542',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 146609,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-25',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 CDI Premium',
 'transmission': 'automatic',
 'trim': 'Premium',
 'year': 2015}
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN31542%27 HTTP/1.1" 200 None
2026-03-28 12:10:40 [auto1.it] INFO: Saving data for CN31542: {'auction_closing_time': 1774714323.0, 'created_time': 1774613291.661637, 'last_price_update_time': 1774699840.76812}
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CN31542') HTTP/1.1" 204 0
2026-03-28 12:10:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 64285844-56ed-5c3a-b334-30939f1c58b4 with identifier: VA29565
2026-03-28 12:10:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 64285844-56ed-5c3a-b334-30939f1c58b4 with identifier: VA29565
2026-03-28 12:10:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 64285844-56ed-5c3a-b334-30939f1c58b4 with identifier: VA29565 to the API
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:07:57Z',
 'fuel_type': 'diesel',
 'id': '64285844-56ed-5c3a-b334-30939f1c58b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA29565',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 115715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-18',
 'seller_name': None,
 'title': 'BMW 5er 520d Luxury Line',
 'transmission': 'automatic',
 'trim': 'Luxury Line',
 'year': 2017}
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VA29565%27 HTTP/1.1" 200 None
2026-03-28 12:10:41 [auto1.it] INFO: Saving data for VA29565: {'auction_closing_time': 1774714077.0, 'created_time': 1774613303.555524, 'last_price_update_time': 1774699841.13008}
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VA29565') HTTP/1.1" 204 0
2026-03-28 12:10:41 [auto1.it] INFO: Found listing with ID: DY75013
2026-03-28 12:10:41 [auto1.it] INFO: Found listing with ID: UC13059
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC13059%27 HTTP/1.1" 200 None
2026-03-28 12:10:41 [auto1.it] INFO: Scrape type for UC13059: 2
2026-03-28 12:10:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e26327f2-f89c-5b89-b9fd-e8a6d6705715 with identifier: UC13059
2026-03-28 12:10:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e26327f2-f89c-5b89-b9fd-e8a6d6705715 with scrape type 2
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e26327f2-f89c-5b89-b9fd-e8a6d6705715 with scrape type 2
2026-03-28 12:10:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e26327f2-f89c-5b89-b9fd-e8a6d6705715, identifier: UC13059
2026-03-28 12:10:41 [auto1.it] INFO: Found listing with ID: TC64761
2026-03-28 12:10:41 [auto1.it] INFO: Found listing with ID: YH58285
2026-03-28 12:10:41 [auto1.it] INFO: Found listing with ID: FM13591
2026-03-28 12:10:41 [auto1.it] INFO: Found listing with ID: BJ23148
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ23148%27 HTTP/1.1" 200 None
2026-03-28 12:10:41 [auto1.it] INFO: Scrape type for BJ23148: 2
2026-03-28 12:10:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cea5f4e0-fbaf-5db2-b03d-1c65d90bb243 with identifier: BJ23148
2026-03-28 12:10:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cea5f4e0-fbaf-5db2-b03d-1c65d90bb243 with scrape type 2
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cea5f4e0-fbaf-5db2-b03d-1c65d90bb243 with scrape type 2
2026-03-28 12:10:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cea5f4e0-fbaf-5db2-b03d-1c65d90bb243, identifier: BJ23148
2026-03-28 12:10:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e26327f2-f89c-5b89-b9fd-e8a6d6705715 with identifier: UC13059
2026-03-28 12:10:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e26327f2-f89c-5b89-b9fd-e8a6d6705715 with identifier: UC13059
2026-03-28 12:10:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e26327f2-f89c-5b89-b9fd-e8a6d6705715 with identifier: UC13059 to the API
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:42:13Z',
 'fuel_type': 'diesel',
 'id': 'e26327f2-f89c-5b89-b9fd-e8a6d6705715',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC13059',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 61530,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-30',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Sd4 SE',
 'transmission': 'automatic',
 'trim': 'SE',
 'year': 2019}
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC13059%27 HTTP/1.1" 200 None
2026-03-28 12:10:42 [auto1.it] INFO: Saving data for UC13059: {'auction_closing_time': 1774716133.0, 'created_time': 1774613277.653986, 'last_price_update_time': 1774699842.111808}
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UC13059') HTTP/1.1" 204 0
2026-03-28 12:10:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cea5f4e0-fbaf-5db2-b03d-1c65d90bb243 with identifier: BJ23148
2026-03-28 12:10:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cea5f4e0-fbaf-5db2-b03d-1c65d90bb243 with identifier: BJ23148
2026-03-28 12:10:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cea5f4e0-fbaf-5db2-b03d-1c65d90bb243 with identifier: BJ23148 to the API
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:15:47Z',
 'fuel_type': 'diesel',
 'id': 'cea5f4e0-fbaf-5db2-b03d-1c65d90bb243',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ23148',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Caravelle',
 'odometer': 93876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-13',
 'seller_name': None,
 'title': 'Volkswagen T6 Caravelle 2.0 TDI Comfortline 4Motion',
 'transmission': 'automatic',
 'trim': 'Comfortline 4Motion',
 'year': 2020}
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ23148%27 HTTP/1.1" 200 None
2026-03-28 12:10:42 [auto1.it] INFO: Saving data for BJ23148: {'auction_closing_time': 1774714547.0, 'created_time': 1774613308.664187, 'last_price_update_time': 1774699842.381059}
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BJ23148') HTTP/1.1" 204 0
2026-03-28 12:10:42 [auto1.it] INFO: Found listing with ID: RU19351
2026-03-28 12:10:42 [auto1.it] INFO: Found listing with ID: JX57169
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX57169%27 HTTP/1.1" 200 None
2026-03-28 12:10:42 [auto1.it] INFO: Scrape type for JX57169: 2
2026-03-28 12:10:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 803f5551-86b3-5353-b1d2-5fba0fa2d34c with identifier: JX57169
2026-03-28 12:10:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 803f5551-86b3-5353-b1d2-5fba0fa2d34c with scrape type 2
2026-03-28 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 803f5551-86b3-5353-b1d2-5fba0fa2d34c with scrape type 2
2026-03-28 12:10:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 803f5551-86b3-5353-b1d2-5fba0fa2d34c, identifier: JX57169
2026-03-28 12:10:42 [auto1.it] INFO: Found listing with ID: YJ83729
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ83729%27 HTTP/1.1" 200 None
2026-03-28 12:10:42 [auto1.it] INFO: Scrape type for YJ83729: 2
2026-03-28 12:10:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a0cadc9-2d5e-532a-8619-4f146c4e079a with identifier: YJ83729
2026-03-28 12:10:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a0cadc9-2d5e-532a-8619-4f146c4e079a with scrape type 2
2026-03-28 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a0cadc9-2d5e-532a-8619-4f146c4e079a with scrape type 2
2026-03-28 12:10:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4a0cadc9-2d5e-532a-8619-4f146c4e079a, identifier: YJ83729
2026-03-28 12:10:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 803f5551-86b3-5353-b1d2-5fba0fa2d34c with identifier: JX57169
2026-03-28 12:10:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 803f5551-86b3-5353-b1d2-5fba0fa2d34c with identifier: JX57169
2026-03-28 12:10:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 803f5551-86b3-5353-b1d2-5fba0fa2d34c with identifier: JX57169 to the API
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:28:57Z',
 'fuel_type': 'diesel',
 'id': '803f5551-86b3-5353-b1d2-5fba0fa2d34c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX57169',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 113684,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-24',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2023}
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX57169%27 HTTP/1.1" 200 None
2026-03-28 12:10:42 [auto1.it] INFO: Saving data for JX57169: {'auction_closing_time': 1774715337.0, 'created_time': 1774041011.26382, 'last_price_update_time': 1774699842.881122}
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JX57169') HTTP/1.1" 204 0
2026-03-28 12:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4a0cadc9-2d5e-532a-8619-4f146c4e079a with identifier: YJ83729
2026-03-28 12:10:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4a0cadc9-2d5e-532a-8619-4f146c4e079a with identifier: YJ83729
2026-03-28 12:10:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4a0cadc9-2d5e-532a-8619-4f146c4e079a with identifier: YJ83729 to the API
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:54:13Z',
 'fuel_type': 'diesel',
 'id': '4a0cadc9-2d5e-532a-8619-4f146c4e079a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ83729',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 162436,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-07',
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Business 4x2',
 'transmission': 'manual',
 'trim': 'Business 4x2',
 'year': 2018}
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ83729%27 HTTP/1.1" 200 None
2026-03-28 12:10:43 [auto1.it] INFO: Saving data for YJ83729: {'auction_closing_time': 1774716853.0, 'created_time': 1773954881.767055, 'last_price_update_time': 1774699843.239471}
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YJ83729') HTTP/1.1" 204 0
2026-03-28 12:10:43 [auto1.it] INFO: Found listing with ID: AE05588
2026-03-28 12:10:43 [auto1.it] INFO: Found listing with ID: ZJ55913
2026-03-28 12:10:43 [auto1.it] INFO: Found listing with ID: AT75049
2026-03-28 12:10:43 [auto1.it] INFO: Found listing with ID: SE76395
2026-03-28 12:10:43 [auto1.it] INFO: Found listing with ID: MB12953
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB12953%27 HTTP/1.1" 200 None
2026-03-28 12:10:43 [auto1.it] INFO: Scrape type for MB12953: 2
2026-03-28 12:10:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14ddac44-41c8-54e5-84b3-ee29180f8d6e with identifier: MB12953
2026-03-28 12:10:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14ddac44-41c8-54e5-84b3-ee29180f8d6e with scrape type 2
2026-03-28 12:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14ddac44-41c8-54e5-84b3-ee29180f8d6e with scrape type 2
2026-03-28 12:10:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 14ddac44-41c8-54e5-84b3-ee29180f8d6e, identifier: MB12953
2026-03-28 12:10:43 [auto1.it] INFO: Found listing with ID: FJ55026
2026-03-28 12:10:43 [auto1.it] INFO: Found listing with ID: RV64880
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV64880%27 HTTP/1.1" 200 None
2026-03-28 12:10:43 [auto1.it] INFO: Scrape type for RV64880: 2
2026-03-28 12:10:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9896a837-478c-5ae4-80c0-0503c8f12a23 with identifier: RV64880
2026-03-28 12:10:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9896a837-478c-5ae4-80c0-0503c8f12a23 with scrape type 2
2026-03-28 12:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9896a837-478c-5ae4-80c0-0503c8f12a23 with scrape type 2
2026-03-28 12:10:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9896a837-478c-5ae4-80c0-0503c8f12a23, identifier: RV64880
2026-03-28 12:10:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 14ddac44-41c8-54e5-84b3-ee29180f8d6e with identifier: MB12953
2026-03-28 12:10:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 14ddac44-41c8-54e5-84b3-ee29180f8d6e with identifier: MB12953
2026-03-28 12:10:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 14ddac44-41c8-54e5-84b3-ee29180f8d6e with identifier: MB12953 to the API
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:36:53Z',
 'fuel_type': 'gas',
 'id': '14ddac44-41c8-54e5-84b3-ee29180f8d6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB12953',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Delta',
 'odometer': 177694,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-30',
 'seller_name': None,
 'title': 'Lancia Delta 1.4 Turbo LPG Gold',
 'transmission': 'manual',
 'trim': 'Gold',
 'year': 2012}
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB12953%27 HTTP/1.1" 200 None
2026-03-28 12:10:43 [auto1.it] INFO: Saving data for MB12953: {'auction_closing_time': 1774715813.0, 'created_time': 1773130011.545428, 'last_price_update_time': 1774699843.73683}
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MB12953') HTTP/1.1" 204 0
2026-03-28 12:10:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9896a837-478c-5ae4-80c0-0503c8f12a23 with identifier: RV64880
2026-03-28 12:10:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9896a837-478c-5ae4-80c0-0503c8f12a23 with identifier: RV64880
2026-03-28 12:10:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9896a837-478c-5ae4-80c0-0503c8f12a23 with identifier: RV64880 to the API
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:09:04Z',
 'fuel_type': 'diesel',
 'id': '9896a837-478c-5ae4-80c0-0503c8f12a23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV64880',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 83371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-28',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2018}
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV64880%27 HTTP/1.1" 200 None
2026-03-28 12:10:44 [auto1.it] INFO: Saving data for RV64880: {'auction_closing_time': 1774714144.0, 'created_time': 1774613237.448361, 'last_price_update_time': 1774699844.032537}
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RV64880') HTTP/1.1" 204 0
2026-03-28 12:10:44 [auto1.it] INFO: Found listing with ID: GU93940
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU93940%27 HTTP/1.1" 200 None
2026-03-28 12:10:44 [auto1.it] INFO: Scrape type for GU93940: 2
2026-03-28 12:10:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3e520f2-f0c4-5073-9cfd-f778991a607c with identifier: GU93940
2026-03-28 12:10:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3e520f2-f0c4-5073-9cfd-f778991a607c with scrape type 2
2026-03-28 12:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3e520f2-f0c4-5073-9cfd-f778991a607c with scrape type 2
2026-03-28 12:10:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f3e520f2-f0c4-5073-9cfd-f778991a607c, identifier: GU93940
2026-03-28 12:10:44 [auto1.it] INFO: Found listing with ID: PS94410
2026-03-28 12:10:44 [auto1.it] INFO: Found listing with ID: PW94940
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW94940%27 HTTP/1.1" 200 None
2026-03-28 12:10:44 [auto1.it] INFO: Scrape type for PW94940: 0
2026-03-28 12:10:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f3e520f2-f0c4-5073-9cfd-f778991a607c with identifier: GU93940
2026-03-28 12:10:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f3e520f2-f0c4-5073-9cfd-f778991a607c with identifier: GU93940
2026-03-28 12:10:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f3e520f2-f0c4-5073-9cfd-f778991a607c with identifier: GU93940 to the API
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:35:56Z',
 'fuel_type': 'diesel',
 'id': 'f3e520f2-f0c4-5073-9cfd-f778991a607c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU93940',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 144141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-04',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Business BlueMotion',
 'transmission': 'manual',
 'trim': 'Business BlueMotion',
 'year': 2018}
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU93940%27 HTTP/1.1" 200 None
2026-03-28 12:10:44 [auto1.it] INFO: Saving data for GU93940: {'auction_closing_time': 1774715756.0, 'created_time': 1773663195.871816, 'last_price_update_time': 1774699844.458894}
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GU93940') HTTP/1.1" 204 0
2026-03-28 12:10:44 [auto1.it] INFO: Found listing with ID: LW86872
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW86872%27 HTTP/1.1" 200 None
2026-03-28 12:10:44 [auto1.it] INFO: Scrape type for LW86872: 2
2026-03-28 12:10:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8c4b797-67b6-532a-8bcb-1a8a58d7413a with identifier: LW86872
2026-03-28 12:10:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8c4b797-67b6-532a-8bcb-1a8a58d7413a with scrape type 2
2026-03-28 12:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8c4b797-67b6-532a-8bcb-1a8a58d7413a with scrape type 2
2026-03-28 12:10:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d8c4b797-67b6-532a-8bcb-1a8a58d7413a, identifier: LW86872
2026-03-28 12:10:44 [auto1.it] INFO: Channel: 24h | Page: 78 | totalHits: 3676 | hits on page: 40
2026-03-28 12:10:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d8c4b797-67b6-532a-8bcb-1a8a58d7413a with identifier: LW86872
2026-03-28 12:10:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d8c4b797-67b6-532a-8bcb-1a8a58d7413a with identifier: LW86872
2026-03-28 12:10:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d8c4b797-67b6-532a-8bcb-1a8a58d7413a with identifier: LW86872 to the API
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:28:20Z',
 'fuel_type': 'diesel',
 'id': 'd8c4b797-67b6-532a-8bcb-1a8a58d7413a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW86872',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 254431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-20',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2015}
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW86872%27 HTTP/1.1" 200 None
2026-03-28 12:10:44 [auto1.it] INFO: Saving data for LW86872: {'auction_closing_time': 1774715300.0, 'created_time': 1774613244.500859, 'last_price_update_time': 1774699844.870769}
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LW86872') HTTP/1.1" 204 0
2026-03-28 12:10:44 [auto1.it] INFO: Found listing with ID: LE96160
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE96160%27 HTTP/1.1" 200 None
2026-03-28 12:10:44 [auto1.it] INFO: Scrape type for LE96160: 2
2026-03-28 12:10:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23796b04-ee09-57b7-be93-5b70af2d5cb1 with identifier: LE96160
2026-03-28 12:10:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23796b04-ee09-57b7-be93-5b70af2d5cb1 with scrape type 2
2026-03-28 12:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23796b04-ee09-57b7-be93-5b70af2d5cb1 with scrape type 2
2026-03-28 12:10:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 23796b04-ee09-57b7-be93-5b70af2d5cb1, identifier: LE96160
2026-03-28 12:10:45 [auto1.it] INFO: Found listing with ID: NP16593
2026-03-28 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP16593%27 HTTP/1.1" 200 None
2026-03-28 12:10:45 [auto1.it] INFO: Scrape type for NP16593: 2
2026-03-28 12:10:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 945bc64d-b4ae-5eec-abbe-e87ceffe7c29 with identifier: NP16593
2026-03-28 12:10:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 945bc64d-b4ae-5eec-abbe-e87ceffe7c29 with scrape type 2
2026-03-28 12:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 945bc64d-b4ae-5eec-abbe-e87ceffe7c29 with scrape type 2
2026-03-28 12:10:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 945bc64d-b4ae-5eec-abbe-e87ceffe7c29, identifier: NP16593
2026-03-28 12:10:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 23796b04-ee09-57b7-be93-5b70af2d5cb1 with identifier: LE96160
2026-03-28 12:10:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 23796b04-ee09-57b7-be93-5b70af2d5cb1 with identifier: LE96160
2026-03-28 12:10:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 23796b04-ee09-57b7-be93-5b70af2d5cb1 with identifier: LE96160 to the API
2026-03-28 12:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:42:41Z',
 'fuel_type': 'diesel',
 'id': '23796b04-ee09-57b7-be93-5b70af2d5cb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE96160',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 166812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-17',
 'seller_name': None,
 'title': 'Volvo XC60 2.4 D4 Ocean Race AWD',
 'transmission': 'automatic',
 'trim': 'Ocean Race AWD',
 'year': 2016}
2026-03-28 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE96160%27 HTTP/1.1" 200 None
2026-03-28 12:10:45 [auto1.it] INFO: Saving data for LE96160: {'auction_closing_time': 1774716161.0, 'created_time': 1774613228.646388, 'last_price_update_time': 1774699845.456793}
2026-03-28 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LE96160') HTTP/1.1" 204 0
2026-03-28 12:10:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 945bc64d-b4ae-5eec-abbe-e87ceffe7c29 with identifier: NP16593
2026-03-28 12:10:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 945bc64d-b4ae-5eec-abbe-e87ceffe7c29 with identifier: NP16593
2026-03-28 12:10:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 945bc64d-b4ae-5eec-abbe-e87ceffe7c29 with identifier: NP16593 to the API
2026-03-28 12:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:18:22Z',
 'fuel_type': 'diesel',
 'id': '945bc64d-b4ae-5eec-abbe-e87ceffe7c29',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP16593',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulia',
 'odometer': 74614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-12',
 'seller_name': None,
 'title': 'Alfa Romeo Giulia 2.2 JTDM Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2018}
2026-03-28 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP16593%27 HTTP/1.1" 200 None
2026-03-28 12:10:45 [auto1.it] INFO: Saving data for NP16593: {'auction_closing_time': 1774714702.0, 'created_time': 1774613235.161797, 'last_price_update_time': 1774699845.72375}
2026-03-28 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NP16593') HTTP/1.1" 204 0
2026-03-28 12:10:45 [auto1.it] INFO: Found listing with ID: FU73160
2026-03-28 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU73160%27 HTTP/1.1" 200 None
2026-03-28 12:10:45 [auto1.it] INFO: Scrape type for FU73160: 2
2026-03-28 12:10:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a191d504-358b-501d-b264-584554de5e55 with identifier: FU73160
2026-03-28 12:10:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a191d504-358b-501d-b264-584554de5e55 with scrape type 2
2026-03-28 12:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a191d504-358b-501d-b264-584554de5e55 with scrape type 2
2026-03-28 12:10:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a191d504-358b-501d-b264-584554de5e55, identifier: FU73160
2026-03-28 12:10:45 [auto1.it] INFO: Found listing with ID: CB44170
2026-03-28 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB44170%27 HTTP/1.1" 200 None
2026-03-28 12:10:45 [auto1.it] INFO: Scrape type for CB44170: 2
2026-03-28 12:10:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c079722-4147-56a6-92de-038b361f198f with identifier: CB44170
2026-03-28 12:10:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c079722-4147-56a6-92de-038b361f198f with scrape type 2
2026-03-28 12:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c079722-4147-56a6-92de-038b361f198f with scrape type 2
2026-03-28 12:10:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2c079722-4147-56a6-92de-038b361f198f, identifier: CB44170
2026-03-28 12:10:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a191d504-358b-501d-b264-584554de5e55 with identifier: FU73160
2026-03-28 12:10:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a191d504-358b-501d-b264-584554de5e55 with identifier: FU73160
2026-03-28 12:10:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a191d504-358b-501d-b264-584554de5e55 with identifier: FU73160 to the API
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:48:59Z',
 'fuel_type': 'diesel',
 'id': 'a191d504-358b-501d-b264-584554de5e55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU73160',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 86497,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-03',
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2022}
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU73160%27 HTTP/1.1" 200 None
2026-03-28 12:10:46 [auto1.it] INFO: Saving data for FU73160: {'auction_closing_time': 1774716539.0, 'created_time': 1774613280.599672, 'last_price_update_time': 1774699846.226956}
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FU73160') HTTP/1.1" 204 0
2026-03-28 12:10:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2c079722-4147-56a6-92de-038b361f198f with identifier: CB44170
2026-03-28 12:10:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2c079722-4147-56a6-92de-038b361f198f with identifier: CB44170
2026-03-28 12:10:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2c079722-4147-56a6-92de-038b361f198f with identifier: CB44170 to the API
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:36:19Z',
 'fuel_type': 'diesel',
 'id': '2c079722-4147-56a6-92de-038b361f198f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB44170',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 230610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-03',
 'seller_name': None,
 'title': 'Volvo XC60 2.4 D4 Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2011}
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB44170%27 HTTP/1.1" 200 None
2026-03-28 12:10:46 [auto1.it] INFO: Saving data for CB44170: {'auction_closing_time': 1774715779.0, 'created_time': 1774613230.870094, 'last_price_update_time': 1774699846.535758}
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CB44170') HTTP/1.1" 204 0
2026-03-28 12:10:46 [auto1.it] INFO: Found listing with ID: UF29900
2026-03-28 12:10:46 [auto1.it] INFO: Found listing with ID: GM73700
2026-03-28 12:10:46 [auto1.it] INFO: Found listing with ID: JP63485
2026-03-28 12:10:46 [auto1.it] INFO: Found listing with ID: AB86109
2026-03-28 12:10:46 [auto1.it] INFO: Found listing with ID: VT00900
2026-03-28 12:10:46 [auto1.it] INFO: Found listing with ID: BW24813
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW24813%27 HTTP/1.1" 200 None
2026-03-28 12:10:46 [auto1.it] INFO: Scrape type for BW24813: 2
2026-03-28 12:10:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7e3b21a-a021-5ee7-8d74-fdc2bee7ac80 with identifier: BW24813
2026-03-28 12:10:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7e3b21a-a021-5ee7-8d74-fdc2bee7ac80 with scrape type 2
2026-03-28 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7e3b21a-a021-5ee7-8d74-fdc2bee7ac80 with scrape type 2
2026-03-28 12:10:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c7e3b21a-a021-5ee7-8d74-fdc2bee7ac80, identifier: BW24813
2026-03-28 12:10:46 [auto1.it] INFO: Found listing with ID: DV62458
2026-03-28 12:10:46 [auto1.it] INFO: Found listing with ID: BJ52580
2026-03-28 12:10:46 [auto1.it] INFO: Found listing with ID: BN67984
2026-03-28 12:10:46 [auto1.it] INFO: Found listing with ID: RJ45303
2026-03-28 12:10:46 [auto1.it] INFO: Found listing with ID: CV62006
2026-03-28 12:10:46 [auto1.it] INFO: Found listing with ID: BV13892
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV13892%27 HTTP/1.1" 200 None
2026-03-28 12:10:46 [auto1.it] INFO: Scrape type for BV13892: 2
2026-03-28 12:10:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ac01c6b-e3fc-5ec4-81e3-c431253a4266 with identifier: BV13892
2026-03-28 12:10:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ac01c6b-e3fc-5ec4-81e3-c431253a4266 with scrape type 2
2026-03-28 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ac01c6b-e3fc-5ec4-81e3-c431253a4266 with scrape type 2
2026-03-28 12:10:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8ac01c6b-e3fc-5ec4-81e3-c431253a4266, identifier: BV13892
2026-03-28 12:10:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c7e3b21a-a021-5ee7-8d74-fdc2bee7ac80 with identifier: BW24813
2026-03-28 12:10:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c7e3b21a-a021-5ee7-8d74-fdc2bee7ac80 with identifier: BW24813
2026-03-28 12:10:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c7e3b21a-a021-5ee7-8d74-fdc2bee7ac80 with identifier: BW24813 to the API
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:40:17Z',
 'fuel_type': 'diesel',
 'id': 'c7e3b21a-a021-5ee7-8d74-fdc2bee7ac80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW24813',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 301584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-27',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.6 JTDM Progression',
 'transmission': 'manual',
 'trim': 'Progression',
 'year': 2013}
2026-03-28 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW24813%27 HTTP/1.1" 200 None
2026-03-28 12:10:47 [auto1.it] INFO: Saving data for BW24813: {'auction_closing_time': 1774716017.0, 'created_time': 1773136061.001188, 'last_price_update_time': 1774699847.075799}
2026-03-28 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BW24813') HTTP/1.1" 204 0
2026-03-28 12:10:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8ac01c6b-e3fc-5ec4-81e3-c431253a4266 with identifier: BV13892
2026-03-28 12:10:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8ac01c6b-e3fc-5ec4-81e3-c431253a4266 with identifier: BV13892
2026-03-28 12:10:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8ac01c6b-e3fc-5ec4-81e3-c431253a4266 with identifier: BV13892 to the API
2026-03-28 12:10:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:06:34Z',
 'fuel_type': 'diesel',
 'id': '8ac01c6b-e3fc-5ec4-81e3-c431253a4266',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV13892',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 155917,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-11',
 'seller_name': None,
 'title': 'Jeep Compass 2.0 M-Jet Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2018}
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV13892%27 HTTP/1.1" 200 None
2026-03-28 12:10:48 [auto1.it] INFO: Saving data for BV13892: {'auction_closing_time': 1774713994.0, 'created_time': 1774473169.386373, 'last_price_update_time': 1774699848.111164}
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BV13892') HTTP/1.1" 204 0
2026-03-28 12:10:48 [auto1.it] INFO: Found listing with ID: GL62022
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL62022%27 HTTP/1.1" 200 None
2026-03-28 12:10:48 [auto1.it] INFO: Scrape type for GL62022: 2
2026-03-28 12:10:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34948c59-dd0c-543b-96c4-44581453a98a with identifier: GL62022
2026-03-28 12:10:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34948c59-dd0c-543b-96c4-44581453a98a with scrape type 2
2026-03-28 12:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34948c59-dd0c-543b-96c4-44581453a98a with scrape type 2
2026-03-28 12:10:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 34948c59-dd0c-543b-96c4-44581453a98a, identifier: GL62022
2026-03-28 12:10:48 [auto1.it] INFO: Found listing with ID: VG64666
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG64666%27 HTTP/1.1" 200 None
2026-03-28 12:10:48 [auto1.it] INFO: Scrape type for VG64666: 0
2026-03-28 12:10:48 [auto1.it] INFO: Found listing with ID: XC82626
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC82626%27 HTTP/1.1" 200 None
2026-03-28 12:10:48 [auto1.it] INFO: Scrape type for XC82626: 2
2026-03-28 12:10:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00feba55-935c-55d3-940e-c91607ece801 with identifier: XC82626
2026-03-28 12:10:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00feba55-935c-55d3-940e-c91607ece801 with scrape type 2
2026-03-28 12:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00feba55-935c-55d3-940e-c91607ece801 with scrape type 2
2026-03-28 12:10:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 00feba55-935c-55d3-940e-c91607ece801, identifier: XC82626
2026-03-28 12:10:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 34948c59-dd0c-543b-96c4-44581453a98a with identifier: GL62022
2026-03-28 12:10:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 34948c59-dd0c-543b-96c4-44581453a98a with identifier: GL62022
2026-03-28 12:10:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 34948c59-dd0c-543b-96c4-44581453a98a with identifier: GL62022 to the API
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:27:41Z',
 'fuel_type': 'diesel',
 'id': '34948c59-dd0c-543b-96c4-44581453a98a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL62022',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Bravo',
 'odometer': 282770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-24',
 'seller_name': None,
 'title': 'Fiat Bravo 1.6 JTDM Multijet Easy',
 'transmission': 'manual',
 'trim': 'Multijet Easy',
 'year': 2013}
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL62022%27 HTTP/1.1" 200 None
2026-03-28 12:10:48 [auto1.it] INFO: Saving data for GL62022: {'auction_closing_time': 1774715261.0, 'created_time': 1772951930.978549, 'last_price_update_time': 1774699848.651347}
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GL62022') HTTP/1.1" 204 0
2026-03-28 12:10:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 00feba55-935c-55d3-940e-c91607ece801 with identifier: XC82626
2026-03-28 12:10:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 00feba55-935c-55d3-940e-c91607ece801 with identifier: XC82626
2026-03-28 12:10:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 00feba55-935c-55d3-940e-c91607ece801 with identifier: XC82626 to the API
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:25:20Z',
 'fuel_type': 'diesel',
 'id': '00feba55-935c-55d3-940e-c91607ece801',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC82626',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 105747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-28',
 'seller_name': None,
 'title': 'Volkswagen Scirocco 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC82626%27 HTTP/1.1" 200 None
2026-03-28 12:10:48 [auto1.it] INFO: Saving data for XC82626: {'auction_closing_time': 1774715120.0, 'created_time': 1774613231.213456, 'last_price_update_time': 1774699848.974986}
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XC82626') HTTP/1.1" 204 0
2026-03-28 12:10:48 [auto1.it] INFO: Found listing with ID: PV85970
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV85970%27 HTTP/1.1" 200 None
2026-03-28 12:10:49 [auto1.it] INFO: Scrape type for PV85970: 2
2026-03-28 12:10:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72532516-9c1f-5450-a6d7-33a75ba4ebda with identifier: PV85970
2026-03-28 12:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72532516-9c1f-5450-a6d7-33a75ba4ebda with scrape type 2
2026-03-28 12:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72532516-9c1f-5450-a6d7-33a75ba4ebda with scrape type 2
2026-03-28 12:10:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 72532516-9c1f-5450-a6d7-33a75ba4ebda, identifier: PV85970
2026-03-28 12:10:49 [auto1.it] INFO: Found listing with ID: WV75327
2026-03-28 12:10:49 [auto1.it] INFO: Found listing with ID: JC13198
2026-03-28 12:10:49 [auto1.it] INFO: Found listing with ID: VS87113
2026-03-28 12:10:49 [auto1.it] INFO: Found listing with ID: YD67684
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD67684%27 HTTP/1.1" 200 None
2026-03-28 12:10:49 [auto1.it] INFO: Scrape type for YD67684: 0
2026-03-28 12:10:49 [auto1.it] INFO: Found listing with ID: VX54252
2026-03-28 12:10:49 [auto1.it] INFO: Found listing with ID: UA46628
2026-03-28 12:10:49 [auto1.it] INFO: Found listing with ID: KG92568
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KG92568%27 HTTP/1.1" 200 None
2026-03-28 12:10:49 [auto1.it] INFO: Scrape type for KG92568: 2
2026-03-28 12:10:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22ed34a4-691f-51c0-a120-4501e60f5dea with identifier: KG92568
2026-03-28 12:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22ed34a4-691f-51c0-a120-4501e60f5dea with scrape type 2
2026-03-28 12:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22ed34a4-691f-51c0-a120-4501e60f5dea with scrape type 2
2026-03-28 12:10:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 22ed34a4-691f-51c0-a120-4501e60f5dea, identifier: KG92568
2026-03-28 12:10:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 72532516-9c1f-5450-a6d7-33a75ba4ebda with identifier: PV85970
2026-03-28 12:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 72532516-9c1f-5450-a6d7-33a75ba4ebda with identifier: PV85970
2026-03-28 12:10:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 72532516-9c1f-5450-a6d7-33a75ba4ebda with identifier: PV85970 to the API
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:56:04Z',
 'fuel_type': 'petrol',
 'id': '72532516-9c1f-5450-a6d7-33a75ba4ebda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV85970',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 107511,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-30',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV85970%27 HTTP/1.1" 200 None
2026-03-28 12:10:49 [auto1.it] INFO: Saving data for PV85970: {'auction_closing_time': 1774716964.0, 'created_time': 1773663462.970707, 'last_price_update_time': 1774699849.486719}
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PV85970') HTTP/1.1" 204 0
2026-03-28 12:10:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 22ed34a4-691f-51c0-a120-4501e60f5dea with identifier: KG92568
2026-03-28 12:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 22ed34a4-691f-51c0-a120-4501e60f5dea with identifier: KG92568
2026-03-28 12:10:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 22ed34a4-691f-51c0-a120-4501e60f5dea with identifier: KG92568 to the API
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:00:12Z',
 'fuel_type': 'gas',
 'id': '22ed34a4-691f-51c0-a120-4501e60f5dea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG92568',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 31431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-10',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe LPG Stepway Essential',
 'transmission': 'manual',
 'trim': 'Stepway Essential',
 'year': 2021}
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KG92568%27 HTTP/1.1" 200 None
2026-03-28 12:10:49 [auto1.it] INFO: Saving data for KG92568: {'auction_closing_time': 1774713612.0, 'created_time': 1774613237.79566, 'last_price_update_time': 1774699849.858007}
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KG92568') HTTP/1.1" 204 0
2026-03-28 12:10:49 [auto1.it] INFO: Found listing with ID: LC62662
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC62662%27 HTTP/1.1" 200 None
2026-03-28 12:10:49 [auto1.it] INFO: Scrape type for LC62662: 2
2026-03-28 12:10:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38b5f3a8-80e6-5b3a-84e8-2c6d166b9a4b with identifier: LC62662
2026-03-28 12:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38b5f3a8-80e6-5b3a-84e8-2c6d166b9a4b with scrape type 2
2026-03-28 12:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38b5f3a8-80e6-5b3a-84e8-2c6d166b9a4b with scrape type 2
2026-03-28 12:10:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 38b5f3a8-80e6-5b3a-84e8-2c6d166b9a4b, identifier: LC62662
2026-03-28 12:10:49 [auto1.it] INFO: Found listing with ID: YJ41537
2026-03-28 12:10:49 [auto1.it] INFO: Found listing with ID: GW20586
2026-03-28 12:10:49 [auto1.it] INFO: Found listing with ID: AL26239
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL26239%27 HTTP/1.1" 200 None
2026-03-28 12:10:49 [auto1.it] INFO: Scrape type for AL26239: 2
2026-03-28 12:10:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7374de2-f3c6-5a75-b653-9a09a4c5d4b6 with identifier: AL26239
2026-03-28 12:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7374de2-f3c6-5a75-b653-9a09a4c5d4b6 with scrape type 2
2026-03-28 12:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7374de2-f3c6-5a75-b653-9a09a4c5d4b6 with scrape type 2
2026-03-28 12:10:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b7374de2-f3c6-5a75-b653-9a09a4c5d4b6, identifier: AL26239
2026-03-28 12:10:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 38b5f3a8-80e6-5b3a-84e8-2c6d166b9a4b with identifier: LC62662
2026-03-28 12:10:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 38b5f3a8-80e6-5b3a-84e8-2c6d166b9a4b with identifier: LC62662
2026-03-28 12:10:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 38b5f3a8-80e6-5b3a-84e8-2c6d166b9a4b with identifier: LC62662 to the API
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:29:31Z',
 'fuel_type': 'diesel',
 'id': '38b5f3a8-80e6-5b3a-84e8-2c6d166b9a4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC62662',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 240646,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-23',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI Advance 4Motion',
 'transmission': 'automatic',
 'trim': 'Advance 4Motion',
 'year': 2019}
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC62662%27 HTTP/1.1" 200 None
2026-03-28 12:10:50 [auto1.it] INFO: Saving data for LC62662: {'auction_closing_time': 1774715371.0, 'created_time': 1774613276.146639, 'last_price_update_time': 1774699850.335186}
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LC62662') HTTP/1.1" 204 0
2026-03-28 12:10:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b7374de2-f3c6-5a75-b653-9a09a4c5d4b6 with identifier: AL26239
2026-03-28 12:10:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b7374de2-f3c6-5a75-b653-9a09a4c5d4b6 with identifier: AL26239
2026-03-28 12:10:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b7374de2-f3c6-5a75-b653-9a09a4c5d4b6 with identifier: AL26239 to the API
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:40:20Z',
 'fuel_type': 'diesel',
 'id': 'b7374de2-f3c6-5a75-b653-9a09a4c5d4b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL26239',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Dokker',
 'odometer': 187184,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-29',
 'seller_name': None,
 'title': 'Dacia Dokker 1.5 dCi Diesel Laureate',
 'transmission': 'manual',
 'trim': 'Laureate',
 'year': 2015}
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL26239%27 HTTP/1.1" 200 None
2026-03-28 12:10:50 [auto1.it] INFO: Saving data for AL26239: {'auction_closing_time': 1774716020.0, 'created_time': 1774613253.749559, 'last_price_update_time': 1774699850.606441}
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AL26239') HTTP/1.1" 204 0
2026-03-28 12:10:50 [auto1.it] INFO: Found listing with ID: EV28185
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV28185%27 HTTP/1.1" 200 None
2026-03-28 12:10:50 [auto1.it] INFO: Scrape type for EV28185: 2
2026-03-28 12:10:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73537eb3-a7a5-5653-896d-4bddabd319e0 with identifier: EV28185
2026-03-28 12:10:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73537eb3-a7a5-5653-896d-4bddabd319e0 with scrape type 2
2026-03-28 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73537eb3-a7a5-5653-896d-4bddabd319e0 with scrape type 2
2026-03-28 12:10:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 73537eb3-a7a5-5653-896d-4bddabd319e0, identifier: EV28185
2026-03-28 12:10:50 [auto1.it] INFO: Found listing with ID: AK60352
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK60352%27 HTTP/1.1" 200 None
2026-03-28 12:10:50 [auto1.it] INFO: Scrape type for AK60352: 2
2026-03-28 12:10:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5be0b1fa-4857-5502-9cdf-8408245c31c6 with identifier: AK60352
2026-03-28 12:10:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5be0b1fa-4857-5502-9cdf-8408245c31c6 with scrape type 2
2026-03-28 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5be0b1fa-4857-5502-9cdf-8408245c31c6 with scrape type 2
2026-03-28 12:10:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5be0b1fa-4857-5502-9cdf-8408245c31c6, identifier: AK60352
2026-03-28 12:10:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 73537eb3-a7a5-5653-896d-4bddabd319e0 with identifier: EV28185
2026-03-28 12:10:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 73537eb3-a7a5-5653-896d-4bddabd319e0 with identifier: EV28185
2026-03-28 12:10:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 73537eb3-a7a5-5653-896d-4bddabd319e0 with identifier: EV28185 to the API
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:02:18Z',
 'fuel_type': 'diesel',
 'id': '73537eb3-a7a5-5653-896d-4bddabd319e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV28185',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 110901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-10',
 'seller_name': None,
 'title': 'Fiat 500X 1.3 M-Jet Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2016}
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV28185%27 HTTP/1.1" 200 None
2026-03-28 12:10:51 [auto1.it] INFO: Saving data for EV28185: {'auction_closing_time': 1774713738.0, 'created_time': 1773133699.120074, 'last_price_update_time': 1774699851.148271}
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EV28185') HTTP/1.1" 204 0
2026-03-28 12:10:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5be0b1fa-4857-5502-9cdf-8408245c31c6 with identifier: AK60352
2026-03-28 12:10:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5be0b1fa-4857-5502-9cdf-8408245c31c6 with identifier: AK60352
2026-03-28 12:10:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5be0b1fa-4857-5502-9cdf-8408245c31c6 with identifier: AK60352 to the API
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:28:06Z',
 'fuel_type': 'petrol',
 'id': '5be0b1fa-4857-5502-9cdf-8408245c31c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK60352',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 75056,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-29',
 'seller_name': None,
 'title': 'Kia Rio 1.0 TGDI Mild-Hybrid Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2020}
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK60352%27 HTTP/1.1" 200 None
2026-03-28 12:10:51 [auto1.it] INFO: Saving data for AK60352: {'auction_closing_time': 1774715286.0, 'created_time': 1774613263.976878, 'last_price_update_time': 1774699851.422355}
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AK60352') HTTP/1.1" 204 0
2026-03-28 12:10:51 [auto1.it] INFO: Found listing with ID: HR15000
2026-03-28 12:10:51 [auto1.it] INFO: Found listing with ID: FA16942
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA16942%27 HTTP/1.1" 200 None
2026-03-28 12:10:51 [auto1.it] INFO: Scrape type for FA16942: 2
2026-03-28 12:10:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9008434d-306e-54b4-9011-d10c498bf417 with identifier: FA16942
2026-03-28 12:10:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9008434d-306e-54b4-9011-d10c498bf417 with scrape type 2
2026-03-28 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9008434d-306e-54b4-9011-d10c498bf417 with scrape type 2
2026-03-28 12:10:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9008434d-306e-54b4-9011-d10c498bf417, identifier: FA16942
2026-03-28 12:10:51 [auto1.it] INFO: Found listing with ID: CH30071
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH30071%27 HTTP/1.1" 200 None
2026-03-28 12:10:51 [auto1.it] INFO: Scrape type for CH30071: 2
2026-03-28 12:10:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96e6f8b5-b993-5ade-9fcf-a86e58f4ba6d with identifier: CH30071
2026-03-28 12:10:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96e6f8b5-b993-5ade-9fcf-a86e58f4ba6d with scrape type 2
2026-03-28 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96e6f8b5-b993-5ade-9fcf-a86e58f4ba6d with scrape type 2
2026-03-28 12:10:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 96e6f8b5-b993-5ade-9fcf-a86e58f4ba6d, identifier: CH30071
2026-03-28 12:10:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9008434d-306e-54b4-9011-d10c498bf417 with identifier: FA16942
2026-03-28 12:10:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9008434d-306e-54b4-9011-d10c498bf417 with identifier: FA16942
2026-03-28 12:10:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9008434d-306e-54b4-9011-d10c498bf417 with identifier: FA16942 to the API
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:54:28Z',
 'fuel_type': 'petrol',
 'id': '9008434d-306e-54b4-9011-d10c498bf417',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA16942',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS3 Crossback',
 'odometer': 94018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-18',
 'seller_name': None,
 'title': 'DS Automobiles DS3 Crossback 1.2 PureTech La Premiere',
 'transmission': 'automatic',
 'trim': 'La Premiere',
 'year': 2019}
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA16942%27 HTTP/1.1" 200 None
2026-03-28 12:10:51 [auto1.it] INFO: Saving data for FA16942: {'auction_closing_time': 1774716868.0, 'created_time': 1774613230.496034, 'last_price_update_time': 1774699851.91091}
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FA16942') HTTP/1.1" 204 0
2026-03-28 12:10:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 96e6f8b5-b993-5ade-9fcf-a86e58f4ba6d with identifier: CH30071
2026-03-28 12:10:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 96e6f8b5-b993-5ade-9fcf-a86e58f4ba6d with identifier: CH30071
2026-03-28 12:10:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 96e6f8b5-b993-5ade-9fcf-a86e58f4ba6d with identifier: CH30071 to the API
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:27:03Z',
 'fuel_type': 'petrol',
 'id': '96e6f8b5-b993-5ade-9fcf-a86e58f4ba6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH30071',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 149265,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-20',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend/Zetec',
 'transmission': 'manual',
 'trim': 'Trend/Zetec',
 'year': 2007}
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH30071%27 HTTP/1.1" 200 None
2026-03-28 12:10:52 [auto1.it] INFO: Saving data for CH30071: {'auction_closing_time': 1774715223.0, 'created_time': 1774613254.186153, 'last_price_update_time': 1774699852.188633}
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CH30071') HTTP/1.1" 204 0
2026-03-28 12:10:52 [auto1.it] INFO: Found listing with ID: ET15005
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET15005%27 HTTP/1.1" 200 None
2026-03-28 12:10:52 [auto1.it] INFO: Scrape type for ET15005: 2
2026-03-28 12:10:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea635f6c-0a83-5f2d-aeea-9ea8fbb77a55 with identifier: ET15005
2026-03-28 12:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea635f6c-0a83-5f2d-aeea-9ea8fbb77a55 with scrape type 2
2026-03-28 12:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea635f6c-0a83-5f2d-aeea-9ea8fbb77a55 with scrape type 2
2026-03-28 12:10:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ea635f6c-0a83-5f2d-aeea-9ea8fbb77a55, identifier: ET15005
2026-03-28 12:10:52 [auto1.it] INFO: Found listing with ID: MW84295
2026-03-28 12:10:52 [auto1.it] INFO: Found listing with ID: PW65105
2026-03-28 12:10:52 [auto1.it] INFO: Found listing with ID: CN99073
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN99073%27 HTTP/1.1" 200 None
2026-03-28 12:10:52 [auto1.it] INFO: Scrape type for CN99073: 2
2026-03-28 12:10:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 757dee4f-2684-5a43-a2fa-1cb1100b0c5e with identifier: CN99073
2026-03-28 12:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 757dee4f-2684-5a43-a2fa-1cb1100b0c5e with scrape type 2
2026-03-28 12:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 757dee4f-2684-5a43-a2fa-1cb1100b0c5e with scrape type 2
2026-03-28 12:10:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 757dee4f-2684-5a43-a2fa-1cb1100b0c5e, identifier: CN99073
2026-03-28 12:10:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ea635f6c-0a83-5f2d-aeea-9ea8fbb77a55 with identifier: ET15005
2026-03-28 12:10:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ea635f6c-0a83-5f2d-aeea-9ea8fbb77a55 with identifier: ET15005
2026-03-28 12:10:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ea635f6c-0a83-5f2d-aeea-9ea8fbb77a55 with identifier: ET15005 to the API
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 147,
 'expiration_date': '2026-03-28T16:10:50Z',
 'fuel_type': 'diesel',
 'id': 'ea635f6c-0a83-5f2d-aeea-9ea8fbb77a55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET15005',
 'listing': 'auction',
 'make': 'Subaru',
 'model': 'XV',
 'odometer': 140930,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-22',
 'seller_name': None,
 'title': 'Subaru XV 2.0 Diesel Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2015}
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET15005%27 HTTP/1.1" 200 None
2026-03-28 12:10:52 [auto1.it] INFO: Saving data for ET15005: {'auction_closing_time': 1774714250.0, 'created_time': 1774613235.591612, 'last_price_update_time': 1774699852.669097}
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ET15005') HTTP/1.1" 204 0
2026-03-28 12:10:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 757dee4f-2684-5a43-a2fa-1cb1100b0c5e with identifier: CN99073
2026-03-28 12:10:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 757dee4f-2684-5a43-a2fa-1cb1100b0c5e with identifier: CN99073
2026-03-28 12:10:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 757dee4f-2684-5a43-a2fa-1cb1100b0c5e with identifier: CN99073 to the API
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:12:09Z',
 'fuel_type': 'diesel',
 'id': '757dee4f-2684-5a43-a2fa-1cb1100b0c5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN99073',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 309051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-24',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2013}
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN99073%27 HTTP/1.1" 200 None
2026-03-28 12:10:53 [auto1.it] INFO: Saving data for CN99073: {'auction_closing_time': 1774714329.0, 'created_time': 1774613268.073696, 'last_price_update_time': 1774699853.075437}
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CN99073') HTTP/1.1" 204 0
2026-03-28 12:10:53 [auto1.it] INFO: Found listing with ID: LM08573
2026-03-28 12:10:53 [auto1.it] INFO: Found listing with ID: MH63316
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH63316%27 HTTP/1.1" 200 None
2026-03-28 12:10:53 [auto1.it] INFO: Scrape type for MH63316: 2
2026-03-28 12:10:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50f49631-6e7b-5bdd-bcb6-c9b2750a210c with identifier: MH63316
2026-03-28 12:10:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50f49631-6e7b-5bdd-bcb6-c9b2750a210c with scrape type 2
2026-03-28 12:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50f49631-6e7b-5bdd-bcb6-c9b2750a210c with scrape type 2
2026-03-28 12:10:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 50f49631-6e7b-5bdd-bcb6-c9b2750a210c, identifier: MH63316
2026-03-28 12:10:53 [auto1.it] INFO: Found listing with ID: ES11783
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES11783%27 HTTP/1.1" 200 None
2026-03-28 12:10:53 [auto1.it] INFO: Scrape type for ES11783: 0
2026-03-28 12:10:53 [auto1.it] INFO: Found listing with ID: RF56449
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF56449%27 HTTP/1.1" 200 None
2026-03-28 12:10:53 [auto1.it] INFO: Scrape type for RF56449: 2
2026-03-28 12:10:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a69edd08-9241-5969-bfc9-d36925ab6915 with identifier: RF56449
2026-03-28 12:10:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a69edd08-9241-5969-bfc9-d36925ab6915 with scrape type 2
2026-03-28 12:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a69edd08-9241-5969-bfc9-d36925ab6915 with scrape type 2
2026-03-28 12:10:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a69edd08-9241-5969-bfc9-d36925ab6915, identifier: RF56449
2026-03-28 12:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 50f49631-6e7b-5bdd-bcb6-c9b2750a210c with identifier: MH63316
2026-03-28 12:10:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 50f49631-6e7b-5bdd-bcb6-c9b2750a210c with identifier: MH63316
2026-03-28 12:10:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 50f49631-6e7b-5bdd-bcb6-c9b2750a210c with identifier: MH63316 to the API
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:03:57Z',
 'fuel_type': 'petrol',
 'id': '50f49631-6e7b-5bdd-bcb6-c9b2750a210c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH63316',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 102482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-14',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2010}
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH63316%27 HTTP/1.1" 200 None
2026-03-28 12:10:53 [auto1.it] INFO: Saving data for MH63316: {'auction_closing_time': 1774713837.0, 'created_time': 1774613231.844104, 'last_price_update_time': 1774699853.689166}
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MH63316') HTTP/1.1" 204 0
2026-03-28 12:10:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a69edd08-9241-5969-bfc9-d36925ab6915 with identifier: RF56449
2026-03-28 12:10:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a69edd08-9241-5969-bfc9-d36925ab6915 with identifier: RF56449
2026-03-28 12:10:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a69edd08-9241-5969-bfc9-d36925ab6915 with identifier: RF56449 to the API
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:11:20Z',
 'fuel_type': 'diesel',
 'id': 'a69edd08-9241-5969-bfc9-d36925ab6915',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF56449',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 185791,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-31',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2009}
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF56449%27 HTTP/1.1" 200 None
2026-03-28 12:10:53 [auto1.it] INFO: Saving data for RF56449: {'auction_closing_time': 1774714280.0, 'created_time': 1774613254.574796, 'last_price_update_time': 1774699853.956305}
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RF56449') HTTP/1.1" 204 0
2026-03-28 12:10:53 [auto1.it] INFO: Found listing with ID: FN23706
2026-03-28 12:10:53 [auto1.it] INFO: Found listing with ID: ZR50624
2026-03-28 12:10:53 [auto1.it] INFO: Found listing with ID: NR19227
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR19227%27 HTTP/1.1" 200 None
2026-03-28 12:10:53 [auto1.it] INFO: Scrape type for NR19227: 2
2026-03-28 12:10:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5abb2a72-b1ff-5eca-965b-9a24e24b7b2b with identifier: NR19227
2026-03-28 12:10:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5abb2a72-b1ff-5eca-965b-9a24e24b7b2b with scrape type 2
2026-03-28 12:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5abb2a72-b1ff-5eca-965b-9a24e24b7b2b with scrape type 2
2026-03-28 12:10:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5abb2a72-b1ff-5eca-965b-9a24e24b7b2b, identifier: NR19227
2026-03-28 12:10:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5abb2a72-b1ff-5eca-965b-9a24e24b7b2b with identifier: NR19227
2026-03-28 12:10:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5abb2a72-b1ff-5eca-965b-9a24e24b7b2b with identifier: NR19227
2026-03-28 12:10:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5abb2a72-b1ff-5eca-965b-9a24e24b7b2b with identifier: NR19227 to the API
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:26:26Z',
 'fuel_type': 'diesel',
 'id': '5abb2a72-b1ff-5eca-965b-9a24e24b7b2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR19227',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 184640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-23',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2015}
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR19227%27 HTTP/1.1" 200 None
2026-03-28 12:10:54 [auto1.it] INFO: Saving data for NR19227: {'auction_closing_time': 1774715186.0, 'created_time': 1773132633.35589, 'last_price_update_time': 1774699854.349566}
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NR19227') HTTP/1.1" 204 0
2026-03-28 12:10:54 [auto1.it] INFO: Found listing with ID: LE11885
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE11885%27 HTTP/1.1" 200 None
2026-03-28 12:10:54 [auto1.it] INFO: Scrape type for LE11885: 0
2026-03-28 12:10:54 [auto1.it] INFO: Found listing with ID: LC05888
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC05888%27 HTTP/1.1" 200 None
2026-03-28 12:10:54 [auto1.it] INFO: Scrape type for LC05888: 2
2026-03-28 12:10:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 904a3078-4f0b-5fff-852b-a3752afe953e with identifier: LC05888
2026-03-28 12:10:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 904a3078-4f0b-5fff-852b-a3752afe953e with scrape type 2
2026-03-28 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 904a3078-4f0b-5fff-852b-a3752afe953e with scrape type 2
2026-03-28 12:10:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 904a3078-4f0b-5fff-852b-a3752afe953e, identifier: LC05888
2026-03-28 12:10:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 904a3078-4f0b-5fff-852b-a3752afe953e with identifier: LC05888
2026-03-28 12:10:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 904a3078-4f0b-5fff-852b-a3752afe953e with identifier: LC05888
2026-03-28 12:10:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 904a3078-4f0b-5fff-852b-a3752afe953e with identifier: LC05888 to the API
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-28T16:26:28Z',
 'fuel_type': 'diesel',
 'id': '904a3078-4f0b-5fff-852b-a3752afe953e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC05888',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 99469,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-30',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d Mild-Hybrid 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2023}
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC05888%27 HTTP/1.1" 200 None
2026-03-28 12:10:54 [auto1.it] INFO: Saving data for LC05888: {'auction_closing_time': 1774715188.0, 'created_time': 1774613266.962716, 'last_price_update_time': 1774699854.751164}
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LC05888') HTTP/1.1" 204 0
2026-03-28 12:10:54 [auto1.it] INFO: Channel: 24h | Page: 79 | totalHits: 3676 | hits on page: 40
2026-03-28 12:10:54 [auto1.it] INFO: Found listing with ID: TL13450
2026-03-28 12:10:54 [auto1.it] INFO: Found listing with ID: HY91699
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY91699%27 HTTP/1.1" 200 None
2026-03-28 12:10:54 [auto1.it] INFO: Scrape type for HY91699: 0
2026-03-28 12:10:54 [auto1.it] INFO: Found listing with ID: ZY78533
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY78533%27 HTTP/1.1" 200 None
2026-03-28 12:10:54 [auto1.it] INFO: Scrape type for ZY78533: 2
2026-03-28 12:10:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ff604d6-9aba-5ae4-baae-1acd23d89dbf with identifier: ZY78533
2026-03-28 12:10:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ff604d6-9aba-5ae4-baae-1acd23d89dbf with scrape type 2
2026-03-28 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ff604d6-9aba-5ae4-baae-1acd23d89dbf with scrape type 2
2026-03-28 12:10:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0ff604d6-9aba-5ae4-baae-1acd23d89dbf, identifier: ZY78533
2026-03-28 12:10:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0ff604d6-9aba-5ae4-baae-1acd23d89dbf with identifier: ZY78533
2026-03-28 12:10:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0ff604d6-9aba-5ae4-baae-1acd23d89dbf with identifier: ZY78533
2026-03-28 12:10:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0ff604d6-9aba-5ae4-baae-1acd23d89dbf with identifier: ZY78533 to the API
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:06:17Z',
 'fuel_type': 'petrol',
 'id': '0ff604d6-9aba-5ae4-baae-1acd23d89dbf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY78533',
 'listing': 'auction',
 'make': 'Tata',
 'model': 'Indica',
 'odometer': 73757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-11-23',
 'seller_name': None,
 'title': 'Tata Indica 1.4 GLE',
 'transmission': 'manual',
 'trim': 'GLE',
 'year': 2005}
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY78533%27 HTTP/1.1" 200 None
2026-03-28 12:10:55 [auto1.it] INFO: Saving data for ZY78533: {'auction_closing_time': 1774713977.0, 'created_time': 1773663029.528605, 'last_price_update_time': 1774699855.16518}
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZY78533') HTTP/1.1" 204 0
2026-03-28 12:10:55 [auto1.it] INFO: Found listing with ID: AK92313
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK92313%27 HTTP/1.1" 200 None
2026-03-28 12:10:55 [auto1.it] INFO: Scrape type for AK92313: 2
2026-03-28 12:10:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b591b1e-6380-5ff7-b26e-fa0da908d78c with identifier: AK92313
2026-03-28 12:10:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b591b1e-6380-5ff7-b26e-fa0da908d78c with scrape type 2
2026-03-28 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b591b1e-6380-5ff7-b26e-fa0da908d78c with scrape type 2
2026-03-28 12:10:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3b591b1e-6380-5ff7-b26e-fa0da908d78c, identifier: AK92313
2026-03-28 12:10:55 [auto1.it] INFO: Found listing with ID: WH00709
2026-03-28 12:10:55 [auto1.it] INFO: Found listing with ID: YM07828
2026-03-28 12:10:55 [auto1.it] INFO: Found listing with ID: BD99197
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD99197%27 HTTP/1.1" 200 None
2026-03-28 12:10:55 [auto1.it] INFO: Scrape type for BD99197: 0
2026-03-28 12:10:55 [auto1.it] INFO: Found listing with ID: CF35894
2026-03-28 12:10:55 [auto1.it] INFO: Found listing with ID: UM78803
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM78803%27 HTTP/1.1" 200 None
2026-03-28 12:10:55 [auto1.it] INFO: Scrape type for UM78803: 2
2026-03-28 12:10:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 614718b0-8121-5e06-abe1-00c210387c9b with identifier: UM78803
2026-03-28 12:10:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 614718b0-8121-5e06-abe1-00c210387c9b with scrape type 2
2026-03-28 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 614718b0-8121-5e06-abe1-00c210387c9b with scrape type 2
2026-03-28 12:10:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 614718b0-8121-5e06-abe1-00c210387c9b, identifier: UM78803
2026-03-28 12:10:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3b591b1e-6380-5ff7-b26e-fa0da908d78c with identifier: AK92313
2026-03-28 12:10:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3b591b1e-6380-5ff7-b26e-fa0da908d78c with identifier: AK92313
2026-03-28 12:10:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3b591b1e-6380-5ff7-b26e-fa0da908d78c with identifier: AK92313 to the API
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:28:42Z',
 'fuel_type': 'diesel',
 'id': '3b591b1e-6380-5ff7-b26e-fa0da908d78c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK92313',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 231463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-29',
 'seller_name': None,
 'title': 'BMW 3er 316d',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK92313%27 HTTP/1.1" 200 None
2026-03-28 12:10:55 [auto1.it] INFO: Saving data for AK92313: {'auction_closing_time': 1774715322.0, 'created_time': 1774613286.464218, 'last_price_update_time': 1774699855.774578}
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AK92313') HTTP/1.1" 204 0
2026-03-28 12:10:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 614718b0-8121-5e06-abe1-00c210387c9b with identifier: UM78803
2026-03-28 12:10:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 614718b0-8121-5e06-abe1-00c210387c9b with identifier: UM78803
2026-03-28 12:10:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 614718b0-8121-5e06-abe1-00c210387c9b with identifier: UM78803 to the API
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:32:51Z',
 'fuel_type': 'diesel',
 'id': '614718b0-8121-5e06-abe1-00c210387c9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM78803',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 223612,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-27',
 'seller_name': None,
 'title': 'Opel Mokka 1.7 CDTI Cosmo ecoFlex',
 'transmission': 'manual',
 'trim': 'Cosmo ecoFlex',
 'year': 2015}
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM78803%27 HTTP/1.1" 200 None
2026-03-28 12:10:56 [auto1.it] INFO: Saving data for UM78803: {'auction_closing_time': 1774715571.0, 'created_time': 1774613258.920338, 'last_price_update_time': 1774699856.04054}
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UM78803') HTTP/1.1" 204 0
2026-03-28 12:10:56 [auto1.it] INFO: Found listing with ID: FZ95983
2026-03-28 12:10:56 [auto1.it] INFO: Found listing with ID: LB07538
2026-03-28 12:10:56 [auto1.it] INFO: Found listing with ID: XT45099
2026-03-28 12:10:56 [auto1.it] INFO: Found listing with ID: SK74491
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK74491%27 HTTP/1.1" 200 None
2026-03-28 12:10:56 [auto1.it] INFO: Scrape type for SK74491: 2
2026-03-28 12:10:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8e239ec-cd0f-5793-a8a3-53921a6e3eeb with identifier: SK74491
2026-03-28 12:10:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8e239ec-cd0f-5793-a8a3-53921a6e3eeb with scrape type 2
2026-03-28 12:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8e239ec-cd0f-5793-a8a3-53921a6e3eeb with scrape type 2
2026-03-28 12:10:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b8e239ec-cd0f-5793-a8a3-53921a6e3eeb, identifier: SK74491
2026-03-28 12:10:56 [auto1.it] INFO: Found listing with ID: LW40364
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW40364%27 HTTP/1.1" 200 None
2026-03-28 12:10:56 [auto1.it] INFO: Scrape type for LW40364: 2
2026-03-28 12:10:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50d2bdd0-20db-5b2d-85eb-cc3c548d8a84 with identifier: LW40364
2026-03-28 12:10:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50d2bdd0-20db-5b2d-85eb-cc3c548d8a84 with scrape type 2
2026-03-28 12:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50d2bdd0-20db-5b2d-85eb-cc3c548d8a84 with scrape type 2
2026-03-28 12:10:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 50d2bdd0-20db-5b2d-85eb-cc3c548d8a84, identifier: LW40364
2026-03-28 12:10:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b8e239ec-cd0f-5793-a8a3-53921a6e3eeb with identifier: SK74491
2026-03-28 12:10:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b8e239ec-cd0f-5793-a8a3-53921a6e3eeb with identifier: SK74491
2026-03-28 12:10:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b8e239ec-cd0f-5793-a8a3-53921a6e3eeb with identifier: SK74491 to the API
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-28T16:06:48Z',
 'fuel_type': 'gas',
 'id': 'b8e239ec-cd0f-5793-a8a3-53921a6e3eeb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK74491',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 251323,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-20',
 'seller_name': None,
 'title': 'Ford Fiesta 1.4 Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2016}
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK74491%27 HTTP/1.1" 200 None
2026-03-28 12:10:56 [auto1.it] INFO: Saving data for SK74491: {'auction_closing_time': 1774714008.0, 'created_time': 1774613284.122407, 'last_price_update_time': 1774699856.519412}
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SK74491') HTTP/1.1" 204 0
2026-03-28 12:10:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 50d2bdd0-20db-5b2d-85eb-cc3c548d8a84 with identifier: LW40364
2026-03-28 12:10:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 50d2bdd0-20db-5b2d-85eb-cc3c548d8a84 with identifier: LW40364
2026-03-28 12:10:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 50d2bdd0-20db-5b2d-85eb-cc3c548d8a84 with identifier: LW40364 to the API
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:34:11Z',
 'fuel_type': 'diesel',
 'id': '50d2bdd0-20db-5b2d-85eb-cc3c548d8a84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW40364',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 72298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-16',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.6 TDI Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2020}
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW40364%27 HTTP/1.1" 200 None
2026-03-28 12:10:56 [auto1.it] INFO: Saving data for LW40364: {'auction_closing_time': 1774715651.0, 'created_time': 1774613285.20857, 'last_price_update_time': 1774699856.907459}
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LW40364') HTTP/1.1" 204 0
2026-03-28 12:10:57 [auto1.it] INFO: Found listing with ID: KN82468
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KN82468%27 HTTP/1.1" 200 None
2026-03-28 12:10:57 [auto1.it] INFO: Scrape type for KN82468: 2
2026-03-28 12:10:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a37c0a25-50ad-5f48-9849-7cbf2cbdeb6d with identifier: KN82468
2026-03-28 12:10:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a37c0a25-50ad-5f48-9849-7cbf2cbdeb6d with scrape type 2
2026-03-28 12:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a37c0a25-50ad-5f48-9849-7cbf2cbdeb6d with scrape type 2
2026-03-28 12:10:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a37c0a25-50ad-5f48-9849-7cbf2cbdeb6d, identifier: KN82468
2026-03-28 12:10:57 [auto1.it] INFO: Found listing with ID: CW25523
2026-03-28 12:10:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a37c0a25-50ad-5f48-9849-7cbf2cbdeb6d with identifier: KN82468
2026-03-28 12:10:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a37c0a25-50ad-5f48-9849-7cbf2cbdeb6d with identifier: KN82468
2026-03-28 12:10:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a37c0a25-50ad-5f48-9849-7cbf2cbdeb6d with identifier: KN82468 to the API
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:06:10Z',
 'fuel_type': 'diesel',
 'id': 'a37c0a25-50ad-5f48-9849-7cbf2cbdeb6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN82468',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 188954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-20',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KN82468%27 HTTP/1.1" 200 None
2026-03-28 12:10:57 [auto1.it] INFO: Saving data for KN82468: {'auction_closing_time': 1774713970.0, 'created_time': 1773130128.062768, 'last_price_update_time': 1774699857.392826}
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KN82468') HTTP/1.1" 204 0
2026-03-28 12:10:57 [auto1.it] INFO: Found listing with ID: MU83341
2026-03-28 12:10:57 [auto1.it] INFO: Found listing with ID: PM68240
2026-03-28 12:10:57 [auto1.it] INFO: Found listing with ID: HR92713
2026-03-28 12:10:57 [auto1.it] INFO: Found listing with ID: JF75950
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF75950%27 HTTP/1.1" 200 None
2026-03-28 12:10:57 [auto1.it] INFO: Scrape type for JF75950: 2
2026-03-28 12:10:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82e739fd-9acd-5714-8a1e-2b26025bb3cf with identifier: JF75950
2026-03-28 12:10:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82e739fd-9acd-5714-8a1e-2b26025bb3cf with scrape type 2
2026-03-28 12:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82e739fd-9acd-5714-8a1e-2b26025bb3cf with scrape type 2
2026-03-28 12:10:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 82e739fd-9acd-5714-8a1e-2b26025bb3cf, identifier: JF75950
2026-03-28 12:10:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 82e739fd-9acd-5714-8a1e-2b26025bb3cf with identifier: JF75950
2026-03-28 12:10:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 82e739fd-9acd-5714-8a1e-2b26025bb3cf with identifier: JF75950
2026-03-28 12:10:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 82e739fd-9acd-5714-8a1e-2b26025bb3cf with identifier: JF75950 to the API
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 341,
 'expiration_date': '2026-03-28T16:54:29Z',
 'fuel_type': 'diesel',
 'id': '82e739fd-9acd-5714-8a1e-2b26025bb3cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF75950',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S4',
 'odometer': 131743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-30',
 'seller_name': None,
 'title': 'Audi S4 3.0 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2022}
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF75950%27 HTTP/1.1" 200 None
2026-03-28 12:10:57 [auto1.it] INFO: Saving data for JF75950: {'auction_closing_time': 1774716869.0, 'created_time': 1774613271.8024, 'last_price_update_time': 1774699857.78496}
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JF75950') HTTP/1.1" 204 0
2026-03-28 12:10:57 [auto1.it] INFO: Found listing with ID: BF69187
2026-03-28 12:10:57 [auto1.it] INFO: Found listing with ID: BL65453
2026-03-28 12:10:57 [auto1.it] INFO: Found listing with ID: PG89190
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PG89190%27 HTTP/1.1" 200 None
2026-03-28 12:10:57 [auto1.it] INFO: Scrape type for PG89190: 2
2026-03-28 12:10:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75d1ffdc-bc1c-5f13-82dc-149ce0f2fe83 with identifier: PG89190
2026-03-28 12:10:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75d1ffdc-bc1c-5f13-82dc-149ce0f2fe83 with scrape type 2
2026-03-28 12:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75d1ffdc-bc1c-5f13-82dc-149ce0f2fe83 with scrape type 2
2026-03-28 12:10:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 75d1ffdc-bc1c-5f13-82dc-149ce0f2fe83, identifier: PG89190
2026-03-28 12:10:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 75d1ffdc-bc1c-5f13-82dc-149ce0f2fe83 with identifier: PG89190
2026-03-28 12:10:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 75d1ffdc-bc1c-5f13-82dc-149ce0f2fe83 with identifier: PG89190
2026-03-28 12:10:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 75d1ffdc-bc1c-5f13-82dc-149ce0f2fe83 with identifier: PG89190 to the API
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:37:51Z',
 'fuel_type': 'diesel',
 'id': '75d1ffdc-bc1c-5f13-82dc-149ce0f2fe83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG89190',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 194299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-27',
 'seller_name': None,
 'title': 'Nissan Qashqai 2.0 dCi Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2011}
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PG89190%27 HTTP/1.1" 200 None
2026-03-28 12:10:58 [auto1.it] INFO: Saving data for PG89190: {'auction_closing_time': 1774715871.0, 'created_time': 1774613278.459005, 'last_price_update_time': 1774699858.187274}
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PG89190') HTTP/1.1" 204 0
2026-03-28 12:10:58 [auto1.it] INFO: Found listing with ID: TW94655
2026-03-28 12:10:58 [auto1.it] INFO: Found listing with ID: DX46579
2026-03-28 12:10:58 [auto1.it] INFO: Found listing with ID: RS22306
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS22306%27 HTTP/1.1" 200 None
2026-03-28 12:10:58 [auto1.it] INFO: Scrape type for RS22306: 2
2026-03-28 12:10:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac32d133-0df4-547d-ad3d-dea49af271a4 with identifier: RS22306
2026-03-28 12:10:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac32d133-0df4-547d-ad3d-dea49af271a4 with scrape type 2
2026-03-28 12:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac32d133-0df4-547d-ad3d-dea49af271a4 with scrape type 2
2026-03-28 12:10:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ac32d133-0df4-547d-ad3d-dea49af271a4, identifier: RS22306
2026-03-28 12:10:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ac32d133-0df4-547d-ad3d-dea49af271a4 with identifier: RS22306
2026-03-28 12:10:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ac32d133-0df4-547d-ad3d-dea49af271a4 with identifier: RS22306
2026-03-28 12:10:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ac32d133-0df4-547d-ad3d-dea49af271a4 with identifier: RS22306 to the API
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 69,
 'expiration_date': '2026-03-28T16:18:24Z',
 'fuel_type': 'gas',
 'id': 'ac32d133-0df4-547d-ad3d-dea49af271a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS22306',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 107273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-30',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 LPG Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2022}
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS22306%27 HTTP/1.1" 200 None
2026-03-28 12:10:58 [auto1.it] INFO: Saving data for RS22306: {'auction_closing_time': 1774714704.0, 'created_time': 1774613273.682913, 'last_price_update_time': 1774699858.557905}
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RS22306') HTTP/1.1" 204 0
2026-03-28 12:10:58 [auto1.it] INFO: Found listing with ID: VD33216
2026-03-28 12:10:58 [auto1.it] INFO: Found listing with ID: EX06757
2026-03-28 12:10:58 [auto1.it] INFO: Found listing with ID: JT03140
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT03140%27 HTTP/1.1" 200 None
2026-03-28 12:10:58 [auto1.it] INFO: Scrape type for JT03140: 2
2026-03-28 12:10:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cc8e9a5-2b91-5bca-8faa-718b97d10bb7 with identifier: JT03140
2026-03-28 12:10:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cc8e9a5-2b91-5bca-8faa-718b97d10bb7 with scrape type 2
2026-03-28 12:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cc8e9a5-2b91-5bca-8faa-718b97d10bb7 with scrape type 2
2026-03-28 12:10:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1cc8e9a5-2b91-5bca-8faa-718b97d10bb7, identifier: JT03140
2026-03-28 12:10:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1cc8e9a5-2b91-5bca-8faa-718b97d10bb7 with identifier: JT03140
2026-03-28 12:10:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1cc8e9a5-2b91-5bca-8faa-718b97d10bb7 with identifier: JT03140
2026-03-28 12:10:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1cc8e9a5-2b91-5bca-8faa-718b97d10bb7 with identifier: JT03140 to the API
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:15:34Z',
 'fuel_type': 'diesel',
 'id': '1cc8e9a5-2b91-5bca-8faa-718b97d10bb7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT03140',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 288394,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-09',
 'seller_name': None,
 'title': 'Renault Scenic 1.5 dCi Luxe',
 'transmission': 'manual',
 'trim': 'Luxe',
 'year': 2010}
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT03140%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [auto1.it] INFO: Saving data for JT03140: {'auction_closing_time': 1774714534.0, 'created_time': 1774613265.364992, 'last_price_update_time': 1774699859.017569}
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JT03140') HTTP/1.1" 204 0
2026-03-28 12:10:59 [auto1.it] INFO: Found listing with ID: ZZ64526
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ64526%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [auto1.it] INFO: Scrape type for ZZ64526: 2
2026-03-28 12:10:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f150be6a-34f0-5c83-965d-9959be11f18c with identifier: ZZ64526
2026-03-28 12:10:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f150be6a-34f0-5c83-965d-9959be11f18c with scrape type 2
2026-03-28 12:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f150be6a-34f0-5c83-965d-9959be11f18c with scrape type 2
2026-03-28 12:10:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f150be6a-34f0-5c83-965d-9959be11f18c, identifier: ZZ64526
2026-03-28 12:10:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f150be6a-34f0-5c83-965d-9959be11f18c with identifier: ZZ64526
2026-03-28 12:10:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f150be6a-34f0-5c83-965d-9959be11f18c with identifier: ZZ64526
2026-03-28 12:10:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f150be6a-34f0-5c83-965d-9959be11f18c with identifier: ZZ64526 to the API
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:59:45Z',
 'fuel_type': 'diesel',
 'id': 'f150be6a-34f0-5c83-965d-9959be11f18c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ64526',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 146748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-14',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 HDi Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2010}
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ64526%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [auto1.it] INFO: Saving data for ZZ64526: {'auction_closing_time': 1774717185.0, 'created_time': 1774440412.134801, 'last_price_update_time': 1774699859.400137}
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZZ64526') HTTP/1.1" 204 0
2026-03-28 12:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:59 [auto1.it] INFO: Found listing with ID: WZ44056
2026-03-28 12:10:59 [auto1.it] INFO: Found listing with ID: AC09989
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AC09989%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [auto1.it] INFO: Scrape type for AC09989: 2
2026-03-28 12:10:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da9cc0c1-6d39-5210-9453-6609a6525003 with identifier: AC09989
2026-03-28 12:10:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da9cc0c1-6d39-5210-9453-6609a6525003 with scrape type 2
2026-03-28 12:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da9cc0c1-6d39-5210-9453-6609a6525003 with scrape type 2
2026-03-28 12:10:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: da9cc0c1-6d39-5210-9453-6609a6525003, identifier: AC09989
2026-03-28 12:10:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: da9cc0c1-6d39-5210-9453-6609a6525003 with identifier: AC09989
2026-03-28 12:10:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: da9cc0c1-6d39-5210-9453-6609a6525003 with identifier: AC09989
2026-03-28 12:10:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: da9cc0c1-6d39-5210-9453-6609a6525003 with identifier: AC09989 to the API
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:16:43Z',
 'fuel_type': 'diesel',
 'id': 'da9cc0c1-6d39-5210-9453-6609a6525003',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC09989',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 242474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-08',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AC09989%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [auto1.it] INFO: Saving data for AC09989: {'auction_closing_time': 1774714603.0, 'created_time': 1774613254.918047, 'last_price_update_time': 1774699859.796687}
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AC09989') HTTP/1.1" 204 0
2026-03-28 12:10:59 [auto1.it] INFO: Found listing with ID: EH65874
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH65874%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [auto1.it] INFO: Scrape type for EH65874: 2
2026-03-28 12:10:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93953d73-86c6-547f-91b3-7a5ed60ca806 with identifier: EH65874
2026-03-28 12:10:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93953d73-86c6-547f-91b3-7a5ed60ca806 with scrape type 2
2026-03-28 12:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93953d73-86c6-547f-91b3-7a5ed60ca806 with scrape type 2
2026-03-28 12:10:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 93953d73-86c6-547f-91b3-7a5ed60ca806, identifier: EH65874
2026-03-28 12:10:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 93953d73-86c6-547f-91b3-7a5ed60ca806 with identifier: EH65874
2026-03-28 12:10:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 93953d73-86c6-547f-91b3-7a5ed60ca806 with identifier: EH65874
2026-03-28 12:11:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 93953d73-86c6-547f-91b3-7a5ed60ca806 with identifier: EH65874 to the API
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:09:17Z',
 'fuel_type': 'diesel',
 'id': '93953d73-86c6-547f-91b3-7a5ed60ca806',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH65874',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 227660,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-29',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI quattro S line Sportpaket plus',
 'transmission': 'manual',
 'trim': 'quattro S line Sportpaket plus',
 'year': 2009}
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH65874%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [auto1.it] INFO: Saving data for EH65874: {'auction_closing_time': 1774714157.0, 'created_time': 1774613270.452896, 'last_price_update_time': 1774699860.227426}
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EH65874') HTTP/1.1" 204 0
2026-03-28 12:11:00 [auto1.it] INFO: Channel: 24h | Page: 80 | totalHits: 3676 | hits on page: 40
2026-03-28 12:11:00 [auto1.it] INFO: Found listing with ID: UA98317
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA98317%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [auto1.it] INFO: Scrape type for UA98317: 2
2026-03-28 12:11:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73b03575-dc2a-5a4e-9741-1bd120c96b56 with identifier: UA98317
2026-03-28 12:11:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73b03575-dc2a-5a4e-9741-1bd120c96b56 with scrape type 2
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73b03575-dc2a-5a4e-9741-1bd120c96b56 with scrape type 2
2026-03-28 12:11:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 73b03575-dc2a-5a4e-9741-1bd120c96b56, identifier: UA98317
2026-03-28 12:11:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 73b03575-dc2a-5a4e-9741-1bd120c96b56 with identifier: UA98317
2026-03-28 12:11:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 73b03575-dc2a-5a4e-9741-1bd120c96b56 with identifier: UA98317
2026-03-28 12:11:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 73b03575-dc2a-5a4e-9741-1bd120c96b56 with identifier: UA98317 to the API
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:12:13Z',
 'fuel_type': 'diesel',
 'id': '73b03575-dc2a-5a4e-9741-1bd120c96b56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA98317',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 179771,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-22',
 'seller_name': None,
 'title': 'MINI Countryman Cooper D ALL4',
 'transmission': 'manual',
 'trim': 'ALL4',
 'year': 2013}
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA98317%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [auto1.it] INFO: Saving data for UA98317: {'auction_closing_time': 1774714333.0, 'created_time': 1774613257.41591, 'last_price_update_time': 1774699860.630633}
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UA98317') HTTP/1.1" 204 0
2026-03-28 12:11:00 [auto1.it] INFO: Found listing with ID: UZ72139
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ72139%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [auto1.it] INFO: Scrape type for UZ72139: 0
2026-03-28 12:11:00 [auto1.it] INFO: Found listing with ID: XP38873
2026-03-28 12:11:00 [auto1.it] INFO: Found listing with ID: PH70338
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PH70338%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [auto1.it] INFO: Scrape type for PH70338: 0
2026-03-28 12:11:00 [auto1.it] INFO: Found listing with ID: RM50913
2026-03-28 12:11:00 [auto1.it] INFO: Found listing with ID: SM29752
2026-03-28 12:11:00 [auto1.it] INFO: Found listing with ID: PT89621
2026-03-28 12:11:00 [auto1.it] INFO: Found listing with ID: LG18660
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG18660%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [auto1.it] INFO: Scrape type for LG18660: 0
2026-03-28 12:11:00 [auto1.it] INFO: Found listing with ID: UA37690
2026-03-28 12:11:00 [auto1.it] INFO: Found listing with ID: DD38287
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD38287%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [auto1.it] INFO: Scrape type for DD38287: 0
2026-03-28 12:11:00 [auto1.it] INFO: Found listing with ID: AN07116
2026-03-28 12:11:00 [auto1.it] INFO: Found listing with ID: FS34329
2026-03-28 12:11:00 [auto1.it] INFO: Found listing with ID: ZU37783
2026-03-28 12:11:00 [auto1.it] INFO: Found listing with ID: MA77848
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA77848%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [auto1.it] INFO: Scrape type for MA77848: 0
2026-03-28 12:11:00 [auto1.it] INFO: Found listing with ID: EZ27389
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ27389%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [auto1.it] INFO: Scrape type for EZ27389: 0
2026-03-28 12:11:00 [auto1.it] INFO: Found listing with ID: NZ40909
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ40909%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [auto1.it] INFO: Scrape type for NZ40909: 0
2026-03-28 12:11:00 [auto1.it] INFO: Found listing with ID: UW92889
2026-03-28 12:11:00 [auto1.it] INFO: Found listing with ID: NC90447
2026-03-28 12:11:00 [auto1.it] INFO: Found listing with ID: GR65234
2026-03-28 12:11:00 [auto1.it] INFO: Found listing with ID: VS88689
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS88689%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [auto1.it] INFO: Scrape type for VS88689: 0
2026-03-28 12:11:00 [auto1.it] INFO: Found listing with ID: KA98059
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA98059%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [auto1.it] INFO: Scrape type for KA98059: 0
2026-03-28 12:11:00 [auto1.it] INFO: Found listing with ID: MZ03364
2026-03-28 12:11:00 [auto1.it] INFO: Found listing with ID: FF49180
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF49180%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [auto1.it] INFO: Scrape type for FF49180: 2
2026-03-28 12:11:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73c19b82-293c-5eff-bc04-4b7025d9936d with identifier: FF49180
2026-03-28 12:11:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73c19b82-293c-5eff-bc04-4b7025d9936d with scrape type 2
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73c19b82-293c-5eff-bc04-4b7025d9936d with scrape type 2
2026-03-28 12:11:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 73c19b82-293c-5eff-bc04-4b7025d9936d, identifier: FF49180
2026-03-28 12:11:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:00 [auto1.it] INFO: Found listing with ID: XE71259
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE71259%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [auto1.it] INFO: Scrape type for XE71259: 0
2026-03-28 12:11:00 [auto1.it] INFO: Found listing with ID: KX33846
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KX33846%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [auto1.it] INFO: Scrape type for KX33846: 0
2026-03-28 12:11:00 [auto1.it] INFO: Found listing with ID: NE12117
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE12117%27 HTTP/1.1" 200 None
2026-03-28 12:11:01 [auto1.it] INFO: Scrape type for NE12117: 0
2026-03-28 12:11:01 [auto1.it] INFO: Found listing with ID: JH33133
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH33133%27 HTTP/1.1" 200 None
2026-03-28 12:11:01 [auto1.it] INFO: Scrape type for JH33133: 0
2026-03-28 12:11:01 [auto1.it] INFO: Found listing with ID: UZ05025
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ05025%27 HTTP/1.1" 200 None
2026-03-28 12:11:01 [auto1.it] INFO: Scrape type for UZ05025: 0
2026-03-28 12:11:01 [auto1.it] INFO: Found listing with ID: MY92785
2026-03-28 12:11:01 [auto1.it] INFO: Found listing with ID: UJ60071
2026-03-28 12:11:01 [auto1.it] INFO: Found listing with ID: HP12790
2026-03-28 12:11:01 [auto1.it] INFO: Found listing with ID: RL61545
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL61545%27 HTTP/1.1" 200 None
2026-03-28 12:11:01 [auto1.it] INFO: Scrape type for RL61545: 0
2026-03-28 12:11:01 [auto1.it] INFO: Found listing with ID: TA87203
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TA87203%27 HTTP/1.1" 200 None
2026-03-28 12:11:01 [auto1.it] INFO: Scrape type for TA87203: 0
2026-03-28 12:11:01 [auto1.it] INFO: Found listing with ID: VV94396
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV94396%27 HTTP/1.1" 200 None
2026-03-28 12:11:01 [auto1.it] INFO: Scrape type for VV94396: 0
2026-03-28 12:11:01 [auto1.it] INFO: Found listing with ID: EY67229
2026-03-28 12:11:01 [auto1.it] INFO: Found listing with ID: BV29552
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV29552%27 HTTP/1.1" 200 None
2026-03-28 12:11:01 [auto1.it] INFO: Scrape type for BV29552: 0
2026-03-28 12:11:01 [auto1.it] INFO: Found listing with ID: EG00977
2026-03-28 12:11:01 [auto1.it] INFO: Found listing with ID: UE31204
2026-03-28 12:11:01 [auto1.it] INFO: Found listing with ID: WW68303
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW68303%27 HTTP/1.1" 200 None
2026-03-28 12:11:01 [auto1.it] INFO: Scrape type for WW68303: 0
2026-03-28 12:11:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 73c19b82-293c-5eff-bc04-4b7025d9936d with identifier: FF49180
2026-03-28 12:11:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 73c19b82-293c-5eff-bc04-4b7025d9936d with identifier: FF49180
2026-03-28 12:11:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 73c19b82-293c-5eff-bc04-4b7025d9936d with identifier: FF49180 to the API
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:41:47Z',
 'fuel_type': 'diesel',
 'id': '73c19b82-293c-5eff-bc04-4b7025d9936d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF49180',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'HR-V',
 'odometer': 128023,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-13',
 'seller_name': None,
 'title': 'Honda HR-V 1.6 DTEC Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2017}
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF49180%27 HTTP/1.1" 200 None
2026-03-28 12:11:01 [auto1.it] INFO: Saving data for FF49180: {'auction_closing_time': 1774716107.0, 'created_time': 1774300290.427144, 'last_price_update_time': 1774699861.468323}
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FF49180') HTTP/1.1" 204 0
2026-03-28 12:11:01 [auto1.it] INFO: Found listing with ID: NZ37386
2026-03-28 12:11:01 [auto1.it] INFO: Found listing with ID: PN03774
2026-03-28 12:11:01 [auto1.it] INFO: Found listing with ID: EV67651
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV67651%27 HTTP/1.1" 200 None
2026-03-28 12:11:01 [auto1.it] INFO: Scrape type for EV67651: 0
2026-03-28 12:11:01 [auto1.it] INFO: Found listing with ID: JV05910
2026-03-28 12:11:01 [auto1.it] INFO: Found listing with ID: KZ16799
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ16799%27 HTTP/1.1" 200 None
2026-03-28 12:11:01 [auto1.it] INFO: Scrape type for KZ16799: 0
2026-03-28 12:11:01 [auto1.it] INFO: Found listing with ID: HZ70208
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HZ70208%27 HTTP/1.1" 200 None
2026-03-28 12:11:01 [auto1.it] INFO: Scrape type for HZ70208: 0
2026-03-28 12:11:01 [auto1.it] INFO: Found listing with ID: EJ60730
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EJ60730%27 HTTP/1.1" 200 None
2026-03-28 12:11:01 [auto1.it] INFO: Scrape type for EJ60730: 0
2026-03-28 12:11:01 [auto1.it] INFO: Found listing with ID: VR56129
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VR56129%27 HTTP/1.1" 200 None
2026-03-28 12:11:01 [auto1.it] INFO: Scrape type for VR56129: 0
2026-03-28 12:11:01 [auto1.it] INFO: Found listing with ID: BE98404
2026-03-28 12:11:01 [auto1.it] INFO: Found listing with ID: CZ22961
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ22961%27 HTTP/1.1" 200 None
2026-03-28 12:11:01 [auto1.it] INFO: Scrape type for CZ22961: 0
2026-03-28 12:11:01 [auto1.it] INFO: Found listing with ID: AY46194
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY46194%27 HTTP/1.1" 200 None
2026-03-28 12:11:01 [auto1.it] INFO: Scrape type for AY46194: 0
2026-03-28 12:11:01 [auto1.it] INFO: Found listing with ID: PR79135
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR79135%27 HTTP/1.1" 200 None
2026-03-28 12:11:01 [auto1.it] INFO: Scrape type for PR79135: 0
2026-03-28 12:11:01 [auto1.it] INFO: Found listing with ID: UC24034
2026-03-28 12:11:01 [auto1.it] INFO: Found listing with ID: FX03621
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX03621%27 HTTP/1.1" 200 None
2026-03-28 12:11:01 [auto1.it] INFO: Scrape type for FX03621: 0
2026-03-28 12:11:01 [auto1.it] INFO: Found listing with ID: AG93268
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG93268%27 HTTP/1.1" 200 None
2026-03-28 12:11:01 [auto1.it] INFO: Scrape type for AG93268: 0
2026-03-28 12:11:01 [auto1.it] INFO: Found listing with ID: XV25356
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV25356%27 HTTP/1.1" 200 None
2026-03-28 12:11:01 [auto1.it] INFO: Scrape type for XV25356: 0
2026-03-28 12:11:01 [auto1.it] INFO: Found listing with ID: SN26450
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN26450%27 HTTP/1.1" 200 None
2026-03-28 12:11:01 [auto1.it] INFO: Scrape type for SN26450: 0
2026-03-28 12:11:01 [auto1.it] INFO: Found listing with ID: PA07928
2026-03-28 12:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:02 [auto1.it] INFO: Channel: 24h | Page: 81 | totalHits: 3676 | hits on page: 40
2026-03-28 12:11:02 [auto1.it] INFO: Found listing with ID: LV99150
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV99150%27 HTTP/1.1" 200 None
2026-03-28 12:11:02 [auto1.it] INFO: Scrape type for LV99150: 0
2026-03-28 12:11:02 [auto1.it] INFO: Found listing with ID: UL06285
2026-03-28 12:11:02 [auto1.it] INFO: Found listing with ID: JB83291
2026-03-28 12:11:02 [auto1.it] INFO: Found listing with ID: TG59717
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG59717%27 HTTP/1.1" 200 None
2026-03-28 12:11:02 [auto1.it] INFO: Scrape type for TG59717: 0
2026-03-28 12:11:02 [auto1.it] INFO: Found listing with ID: DX02178
2026-03-28 12:11:02 [auto1.it] INFO: Found listing with ID: BD73790
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD73790%27 HTTP/1.1" 200 None
2026-03-28 12:11:02 [auto1.it] INFO: Scrape type for BD73790: 0
2026-03-28 12:11:02 [auto1.it] INFO: Found listing with ID: PK74621
2026-03-28 12:11:02 [auto1.it] INFO: Found listing with ID: TG93645
2026-03-28 12:11:02 [auto1.it] INFO: Found listing with ID: DD55036
2026-03-28 12:11:02 [auto1.it] INFO: Found listing with ID: SH99694
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH99694%27 HTTP/1.1" 200 None
2026-03-28 12:11:02 [auto1.it] INFO: Scrape type for SH99694: 0
2026-03-28 12:11:02 [auto1.it] INFO: Found listing with ID: NF38082
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF38082%27 HTTP/1.1" 200 None
2026-03-28 12:11:02 [auto1.it] INFO: Scrape type for NF38082: 0
2026-03-28 12:11:02 [auto1.it] INFO: Found listing with ID: BY06123
2026-03-28 12:11:02 [auto1.it] INFO: Found listing with ID: PT68883
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT68883%27 HTTP/1.1" 200 None
2026-03-28 12:11:02 [auto1.it] INFO: Scrape type for PT68883: 0
2026-03-28 12:11:02 [auto1.it] INFO: Found listing with ID: BF81880
2026-03-28 12:11:02 [auto1.it] INFO: Found listing with ID: HG18459
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG18459%27 HTTP/1.1" 200 None
2026-03-28 12:11:02 [auto1.it] INFO: Scrape type for HG18459: 0
2026-03-28 12:11:02 [auto1.it] INFO: Found listing with ID: SB68054
2026-03-28 12:11:02 [auto1.it] INFO: Found listing with ID: VY30881
2026-03-28 12:11:02 [auto1.it] INFO: Found listing with ID: KT34727
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT34727%27 HTTP/1.1" 200 None
2026-03-28 12:11:02 [auto1.it] INFO: Scrape type for KT34727: 0
2026-03-28 12:11:02 [auto1.it] INFO: Found listing with ID: YB75201
2026-03-28 12:11:02 [auto1.it] INFO: Found listing with ID: UE17288
2026-03-28 12:11:02 [auto1.it] INFO: Found listing with ID: YX10047
2026-03-28 12:11:02 [auto1.it] INFO: Found listing with ID: BD43330
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD43330%27 HTTP/1.1" 200 None
2026-03-28 12:11:03 [auto1.it] INFO: Scrape type for BD43330: 0
2026-03-28 12:11:03 [auto1.it] INFO: Found listing with ID: FT22704
2026-03-28 12:11:03 [auto1.it] INFO: Found listing with ID: FU42856
2026-03-28 12:11:03 [auto1.it] INFO: Found listing with ID: WY54071
2026-03-28 12:11:03 [auto1.it] INFO: Found listing with ID: CS68621
2026-03-28 12:11:03 [auto1.it] INFO: Found listing with ID: FT43083
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT43083%27 HTTP/1.1" 200 None
2026-03-28 12:11:03 [auto1.it] INFO: Scrape type for FT43083: 0
2026-03-28 12:11:03 [auto1.it] INFO: Found listing with ID: HU04780
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU04780%27 HTTP/1.1" 200 None
2026-03-28 12:11:03 [auto1.it] INFO: Scrape type for HU04780: 0
2026-03-28 12:11:03 [auto1.it] INFO: Found listing with ID: BM42520
2026-03-28 12:11:03 [auto1.it] INFO: Found listing with ID: MD14180
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD14180%27 HTTP/1.1" 200 None
2026-03-28 12:11:03 [auto1.it] INFO: Scrape type for MD14180: 2
2026-03-28 12:11:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70 with identifier: MD14180
2026-03-28 12:11:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70 with scrape type 2
2026-03-28 12:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70 with scrape type 2
2026-03-28 12:11:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70, identifier: MD14180
2026-03-28 12:11:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70 with identifier: MD14180
2026-03-28 12:11:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70 with identifier: MD14180
2026-03-28 12:11:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70 with identifier: MD14180 to the API
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:24:56Z',
 'fuel_type': 'petrol',
 'id': '367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD14180',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 65237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-30',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI ACT Executive BlueMotion',
 'transmission': 'automatic',
 'trim': 'Executive BlueMotion',
 'year': 2017}
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD14180%27 HTTP/1.1" 200 None
2026-03-28 12:11:03 [auto1.it] INFO: Saving data for MD14180: {'auction_closing_time': 1774715096.0, 'created_time': 1774300178.310511, 'last_price_update_time': 1774699863.49877}
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MD14180') HTTP/1.1" 204 0
2026-03-28 12:11:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:03 [auto1.it] INFO: Found listing with ID: PY21369
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY21369%27 HTTP/1.1" 200 None
2026-03-28 12:11:03 [auto1.it] INFO: Scrape type for PY21369: 0
2026-03-28 12:11:03 [auto1.it] INFO: Found listing with ID: XZ55537
2026-03-28 12:11:03 [auto1.it] INFO: Found listing with ID: XW45727
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW45727%27 HTTP/1.1" 200 None
2026-03-28 12:11:03 [auto1.it] INFO: Scrape type for XW45727: 0
2026-03-28 12:11:03 [auto1.it] INFO: Found listing with ID: MJ56549
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ56549%27 HTTP/1.1" 200 None
2026-03-28 12:11:03 [auto1.it] INFO: Scrape type for MJ56549: 0
2026-03-28 12:11:03 [auto1.it] INFO: Found listing with ID: RG49415
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG49415%27 HTTP/1.1" 200 None
2026-03-28 12:11:03 [auto1.it] INFO: Scrape type for RG49415: 0
2026-03-28 12:11:03 [auto1.it] INFO: Found listing with ID: MZ03960
2026-03-28 12:11:03 [auto1.it] INFO: Found listing with ID: SX19566
2026-03-28 12:11:03 [auto1.it] INFO: Found listing with ID: TT73216
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT73216%27 HTTP/1.1" 200 None
2026-03-28 12:11:03 [auto1.it] INFO: Scrape type for TT73216: 0
2026-03-28 12:11:03 [auto1.it] INFO: Found listing with ID: SW30840
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SW30840%27 HTTP/1.1" 200 None
2026-03-28 12:11:03 [auto1.it] INFO: Scrape type for SW30840: 0
2026-03-28 12:11:03 [auto1.it] INFO: Found listing with ID: JT48153
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT48153%27 HTTP/1.1" 200 None
2026-03-28 12:11:03 [auto1.it] INFO: Scrape type for JT48153: 0
2026-03-28 12:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:04 [auto1.it] INFO: Channel: 24h | Page: 82 | totalHits: 3676 | hits on page: 40
2026-03-28 12:11:04 [auto1.it] INFO: Found listing with ID: XY41121
2026-03-28 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY41121%27 HTTP/1.1" 200 None
2026-03-28 12:11:04 [auto1.it] INFO: Scrape type for XY41121: 0
2026-03-28 12:11:04 [auto1.it] INFO: Found listing with ID: NP81459
2026-03-28 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP81459%27 HTTP/1.1" 200 None
2026-03-28 12:11:04 [auto1.it] INFO: Scrape type for NP81459: 2
2026-03-28 12:11:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 164a142a-9a7d-5562-be36-50f2bf7d431e with identifier: NP81459
2026-03-28 12:11:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 164a142a-9a7d-5562-be36-50f2bf7d431e with scrape type 2
2026-03-28 12:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 164a142a-9a7d-5562-be36-50f2bf7d431e with scrape type 2
2026-03-28 12:11:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 164a142a-9a7d-5562-be36-50f2bf7d431e, identifier: NP81459
2026-03-28 12:11:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 164a142a-9a7d-5562-be36-50f2bf7d431e with identifier: NP81459
2026-03-28 12:11:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 164a142a-9a7d-5562-be36-50f2bf7d431e with identifier: NP81459
2026-03-28 12:11:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 164a142a-9a7d-5562-be36-50f2bf7d431e with identifier: NP81459 to the API
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:05:22Z',
 'fuel_type': 'petrol',
 'id': '164a142a-9a7d-5562-be36-50f2bf7d431e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP81459',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 177400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-05',
 'seller_name': None,
 'title': 'Kia Sportage 2.0 Active 2WD',
 'transmission': 'manual',
 'trim': 'Active 2WD',
 'year': 2009}
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP81459%27 HTTP/1.1" 200 None
2026-03-28 12:11:05 [auto1.it] INFO: Saving data for NP81459: {'auction_closing_time': 1774713922.0, 'created_time': 1774300314.499016, 'last_price_update_time': 1774699865.200364}
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NP81459') HTTP/1.1" 204 0
2026-03-28 12:11:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:05 [auto1.it] INFO: Found listing with ID: YG79824
2026-03-28 12:11:05 [auto1.it] INFO: Found listing with ID: JD30640
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD30640%27 HTTP/1.1" 200 None
2026-03-28 12:11:05 [auto1.it] INFO: Scrape type for JD30640: 0
2026-03-28 12:11:05 [auto1.it] INFO: Found listing with ID: WL66559
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL66559%27 HTTP/1.1" 200 None
2026-03-28 12:11:05 [auto1.it] INFO: Scrape type for WL66559: 0
2026-03-28 12:11:05 [auto1.it] INFO: Found listing with ID: HD95534
2026-03-28 12:11:05 [auto1.it] INFO: Found listing with ID: HY50336
2026-03-28 12:11:05 [auto1.it] INFO: Found listing with ID: TU52552
2026-03-28 12:11:05 [auto1.it] INFO: Found listing with ID: SP76043
2026-03-28 12:11:05 [auto1.it] INFO: Found listing with ID: DS02463
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS02463%27 HTTP/1.1" 200 None
2026-03-28 12:11:05 [auto1.it] INFO: Scrape type for DS02463: 0
2026-03-28 12:11:05 [auto1.it] INFO: Found listing with ID: DV09922
2026-03-28 12:11:05 [auto1.it] INFO: Found listing with ID: CM00839
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM00839%27 HTTP/1.1" 200 None
2026-03-28 12:11:05 [auto1.it] INFO: Scrape type for CM00839: 0
2026-03-28 12:11:05 [auto1.it] INFO: Found listing with ID: TL02319
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL02319%27 HTTP/1.1" 200 None
2026-03-28 12:11:05 [auto1.it] INFO: Scrape type for TL02319: 0
2026-03-28 12:11:05 [auto1.it] INFO: Found listing with ID: KT26389
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT26389%27 HTTP/1.1" 200 None
2026-03-28 12:11:05 [auto1.it] INFO: Scrape type for KT26389: 0
2026-03-28 12:11:05 [auto1.it] INFO: Found listing with ID: FB26923
2026-03-28 12:11:05 [auto1.it] INFO: Found listing with ID: FC72088
2026-03-28 12:11:05 [auto1.it] INFO: Found listing with ID: CA11723
2026-03-28 12:11:05 [auto1.it] INFO: Found listing with ID: EZ66710
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ66710%27 HTTP/1.1" 200 None
2026-03-28 12:11:05 [auto1.it] INFO: Scrape type for EZ66710: 0
2026-03-28 12:11:05 [auto1.it] INFO: Found listing with ID: HW61207
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW61207%27 HTTP/1.1" 200 None
2026-03-28 12:11:05 [auto1.it] INFO: Scrape type for HW61207: 0
2026-03-28 12:11:05 [auto1.it] INFO: Found listing with ID: UB12324
2026-03-28 12:11:05 [auto1.it] INFO: Found listing with ID: ZZ85760
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ85760%27 HTTP/1.1" 200 None
2026-03-28 12:11:05 [auto1.it] INFO: Scrape type for ZZ85760: 0
2026-03-28 12:11:05 [auto1.it] INFO: Found listing with ID: DS09153
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS09153%27 HTTP/1.1" 200 None
2026-03-28 12:11:05 [auto1.it] INFO: Scrape type for DS09153: 2
2026-03-28 12:11:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76d30135-40f2-5374-95a6-e0f075afcfe7 with identifier: DS09153
2026-03-28 12:11:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76d30135-40f2-5374-95a6-e0f075afcfe7 with scrape type 2
2026-03-28 12:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76d30135-40f2-5374-95a6-e0f075afcfe7 with scrape type 2
2026-03-28 12:11:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 76d30135-40f2-5374-95a6-e0f075afcfe7, identifier: DS09153
2026-03-28 12:11:05 [scrapy.extensions.logstats] INFO: Crawled 278 pages (at 9 pages/min), scraped 354 items (at 131 items/min)
2026-03-28 12:11:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 200MiB
2026-03-28 12:11:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 76d30135-40f2-5374-95a6-e0f075afcfe7 with identifier: DS09153
2026-03-28 12:11:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 76d30135-40f2-5374-95a6-e0f075afcfe7 with identifier: DS09153
2026-03-28 12:11:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 76d30135-40f2-5374-95a6-e0f075afcfe7 with identifier: DS09153 to the API
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:07:35Z',
 'fuel_type': 'diesel',
 'id': '76d30135-40f2-5374-95a6-e0f075afcfe7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS09153',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 90114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-25',
 'seller_name': None,
 'title': 'Skoda Kamiq 1.6 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2020}
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS09153%27 HTTP/1.1" 200 None
2026-03-28 12:11:05 [auto1.it] INFO: Saving data for DS09153: {'auction_closing_time': 1774714055.0, 'created_time': 1774300279.358867, 'last_price_update_time': 1774699865.868937}
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DS09153') HTTP/1.1" 204 0
2026-03-28 12:11:05 [auto1.it] INFO: Found listing with ID: PV39557
2026-03-28 12:11:05 [auto1.it] INFO: Found listing with ID: JU08968
2026-03-28 12:11:05 [auto1.it] INFO: Found listing with ID: RM13688
2026-03-28 12:11:05 [auto1.it] INFO: Found listing with ID: DS07920
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS07920%27 HTTP/1.1" 200 None
2026-03-28 12:11:06 [auto1.it] INFO: Scrape type for DS07920: 0
2026-03-28 12:11:06 [auto1.it] INFO: Found listing with ID: BJ95013
2026-03-28 12:11:06 [auto1.it] INFO: Found listing with ID: AH42596
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH42596%27 HTTP/1.1" 200 None
2026-03-28 12:11:06 [auto1.it] INFO: Scrape type for AH42596: 0
2026-03-28 12:11:06 [auto1.it] INFO: Found listing with ID: XJ39556
2026-03-28 12:11:06 [auto1.it] INFO: Found listing with ID: PE96276
2026-03-28 12:11:06 [auto1.it] INFO: Found listing with ID: VX84045
2026-03-28 12:11:06 [auto1.it] INFO: Found listing with ID: JC61958
2026-03-28 12:11:06 [auto1.it] INFO: Found listing with ID: WB02542
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB02542%27 HTTP/1.1" 200 None
2026-03-28 12:11:06 [auto1.it] INFO: Scrape type for WB02542: 0
2026-03-28 12:11:06 [auto1.it] INFO: Found listing with ID: KW54926
2026-03-28 12:11:06 [auto1.it] INFO: Found listing with ID: MH68095
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH68095%27 HTTP/1.1" 200 None
2026-03-28 12:11:06 [auto1.it] INFO: Scrape type for MH68095: 0
2026-03-28 12:11:06 [auto1.it] INFO: Found listing with ID: TT28559
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT28559%27 HTTP/1.1" 200 None
2026-03-28 12:11:06 [auto1.it] INFO: Scrape type for TT28559: 0
2026-03-28 12:11:06 [auto1.it] INFO: Found listing with ID: HG73673
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG73673%27 HTTP/1.1" 200 None
2026-03-28 12:11:06 [auto1.it] INFO: Scrape type for HG73673: 0
2026-03-28 12:11:06 [auto1.it] INFO: Found listing with ID: SS18980
2026-03-28 12:11:06 [auto1.it] INFO: Found listing with ID: FZ15341
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FZ15341%27 HTTP/1.1" 200 None
2026-03-28 12:11:06 [auto1.it] INFO: Scrape type for FZ15341: 0
2026-03-28 12:11:06 [auto1.it] INFO: Found listing with ID: UH39950
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH39950%27 HTTP/1.1" 200 None
2026-03-28 12:11:06 [auto1.it] INFO: Scrape type for UH39950: 0
2026-03-28 12:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:07 [auto1.it] INFO: Channel: 24h | Page: 83 | totalHits: 3676 | hits on page: 40
2026-03-28 12:11:07 [auto1.it] INFO: Found listing with ID: WU48456
2026-03-28 12:11:07 [auto1.it] INFO: Found listing with ID: WN29902
2026-03-28 12:11:07 [auto1.it] INFO: Found listing with ID: AZ64167
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ64167%27 HTTP/1.1" 200 None
2026-03-28 12:11:07 [auto1.it] INFO: Scrape type for AZ64167: 0
2026-03-28 12:11:07 [auto1.it] INFO: Found listing with ID: ZG57893
2026-03-28 12:11:07 [auto1.it] INFO: Found listing with ID: LR70211
2026-03-28 12:11:07 [auto1.it] INFO: Found listing with ID: LY33062
2026-03-28 12:11:07 [auto1.it] INFO: Found listing with ID: HD69394
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD69394%27 HTTP/1.1" 200 None
2026-03-28 12:11:07 [auto1.it] INFO: Scrape type for HD69394: 0
2026-03-28 12:11:07 [auto1.it] INFO: Found listing with ID: UR14764
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR14764%27 HTTP/1.1" 200 None
2026-03-28 12:11:07 [auto1.it] INFO: Scrape type for UR14764: 0
2026-03-28 12:11:07 [auto1.it] INFO: Found listing with ID: XY34648
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY34648%27 HTTP/1.1" 200 None
2026-03-28 12:11:07 [auto1.it] INFO: Scrape type for XY34648: 2
2026-03-28 12:11:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30503fda-e45f-546f-908e-052db1497634 with identifier: XY34648
2026-03-28 12:11:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30503fda-e45f-546f-908e-052db1497634 with scrape type 2
2026-03-28 12:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30503fda-e45f-546f-908e-052db1497634 with scrape type 2
2026-03-28 12:11:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 30503fda-e45f-546f-908e-052db1497634, identifier: XY34648
2026-03-28 12:11:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 30503fda-e45f-546f-908e-052db1497634 with identifier: XY34648
2026-03-28 12:11:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 30503fda-e45f-546f-908e-052db1497634 with identifier: XY34648
2026-03-28 12:11:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 30503fda-e45f-546f-908e-052db1497634 with identifier: XY34648 to the API
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:46:22Z',
 'fuel_type': 'diesel',
 'id': '30503fda-e45f-546f-908e-052db1497634',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY34648',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 102890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-29',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY34648%27 HTTP/1.1" 200 None
2026-03-28 12:11:07 [auto1.it] INFO: Saving data for XY34648: {'auction_closing_time': 1774716382.0, 'created_time': 1774300298.325757, 'last_price_update_time': 1774699867.819564}
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XY34648') HTTP/1.1" 204 0
2026-03-28 12:11:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:07 [auto1.it] INFO: Found listing with ID: LK74824
2026-03-28 12:11:07 [auto1.it] INFO: Found listing with ID: JV49964
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV49964%27 HTTP/1.1" 200 None
2026-03-28 12:11:07 [auto1.it] INFO: Scrape type for JV49964: 0
2026-03-28 12:11:07 [auto1.it] INFO: Found listing with ID: RB26067
2026-03-28 12:11:07 [auto1.it] INFO: Found listing with ID: JK56818
2026-03-28 12:11:07 [auto1.it] INFO: Found listing with ID: LP45822
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LP45822%27 HTTP/1.1" 200 None
2026-03-28 12:11:07 [auto1.it] INFO: Scrape type for LP45822: 0
2026-03-28 12:11:07 [auto1.it] INFO: Found listing with ID: KF78303
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF78303%27 HTTP/1.1" 200 None
2026-03-28 12:11:07 [auto1.it] INFO: Scrape type for KF78303: 0
2026-03-28 12:11:07 [auto1.it] INFO: Found listing with ID: AS07739
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AS07739%27 HTTP/1.1" 200 None
2026-03-28 12:11:07 [auto1.it] INFO: Scrape type for AS07739: 0
2026-03-28 12:11:07 [auto1.it] INFO: Found listing with ID: CD01213
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD01213%27 HTTP/1.1" 200 None
2026-03-28 12:11:08 [auto1.it] INFO: Scrape type for CD01213: 0
2026-03-28 12:11:08 [auto1.it] INFO: Found listing with ID: EW42527
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW42527%27 HTTP/1.1" 200 None
2026-03-28 12:11:08 [auto1.it] INFO: Scrape type for EW42527: 0
2026-03-28 12:11:08 [auto1.it] INFO: Found listing with ID: JU78402
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU78402%27 HTTP/1.1" 200 None
2026-03-28 12:11:08 [auto1.it] INFO: Scrape type for JU78402: 0
2026-03-28 12:11:08 [auto1.it] INFO: Found listing with ID: FZ10631
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FZ10631%27 HTTP/1.1" 200 None
2026-03-28 12:11:08 [auto1.it] INFO: Scrape type for FZ10631: 0
2026-03-28 12:11:08 [auto1.it] INFO: Found listing with ID: PR30387
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR30387%27 HTTP/1.1" 200 None
2026-03-28 12:11:08 [auto1.it] INFO: Scrape type for PR30387: 0
2026-03-28 12:11:08 [auto1.it] INFO: Found listing with ID: XD70855
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD70855%27 HTTP/1.1" 200 None
2026-03-28 12:11:08 [auto1.it] INFO: Scrape type for XD70855: 0
2026-03-28 12:11:08 [auto1.it] INFO: Found listing with ID: KK35105
2026-03-28 12:11:08 [auto1.it] INFO: Found listing with ID: FD87905
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD87905%27 HTTP/1.1" 200 None
2026-03-28 12:11:08 [auto1.it] INFO: Scrape type for FD87905: 0
2026-03-28 12:11:08 [auto1.it] INFO: Found listing with ID: EU38381
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU38381%27 HTTP/1.1" 200 None
2026-03-28 12:11:08 [auto1.it] INFO: Scrape type for EU38381: 0
2026-03-28 12:11:08 [auto1.it] INFO: Found listing with ID: EA99644
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA99644%27 HTTP/1.1" 200 None
2026-03-28 12:11:08 [auto1.it] INFO: Scrape type for EA99644: 0
2026-03-28 12:11:08 [auto1.it] INFO: Found listing with ID: FT94062
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT94062%27 HTTP/1.1" 200 None
2026-03-28 12:11:08 [auto1.it] INFO: Scrape type for FT94062: 0
2026-03-28 12:11:08 [auto1.it] INFO: Found listing with ID: ED98224
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED98224%27 HTTP/1.1" 200 None
2026-03-28 12:11:08 [auto1.it] INFO: Scrape type for ED98224: 0
2026-03-28 12:11:08 [auto1.it] INFO: Found listing with ID: DV90531
2026-03-28 12:11:08 [auto1.it] INFO: Found listing with ID: WG94514
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG94514%27 HTTP/1.1" 200 None
2026-03-28 12:11:08 [auto1.it] INFO: Scrape type for WG94514: 0
2026-03-28 12:11:08 [auto1.it] INFO: Found listing with ID: KE74592
2026-03-28 12:11:08 [auto1.it] INFO: Found listing with ID: RA84354
2026-03-28 12:11:08 [auto1.it] INFO: Found listing with ID: NT11806
2026-03-28 12:11:08 [auto1.it] INFO: Found listing with ID: PZ52577
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ52577%27 HTTP/1.1" 200 None
2026-03-28 12:11:08 [auto1.it] INFO: Scrape type for PZ52577: 0
2026-03-28 12:11:08 [auto1.it] INFO: Found listing with ID: MA17223
2026-03-28 12:11:08 [auto1.it] INFO: Found listing with ID: ZM35614
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM35614%27 HTTP/1.1" 200 None
2026-03-28 12:11:08 [auto1.it] INFO: Scrape type for ZM35614: 0
2026-03-28 12:11:08 [auto1.it] INFO: Found listing with ID: FS29770
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FS29770%27 HTTP/1.1" 200 None
2026-03-28 12:11:08 [auto1.it] INFO: Scrape type for FS29770: 0
2026-03-28 12:11:08 [auto1.it] INFO: Found listing with ID: XW21530
2026-03-28 12:11:08 [auto1.it] INFO: Found listing with ID: PU63843
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PU63843%27 HTTP/1.1" 200 None
2026-03-28 12:11:08 [auto1.it] INFO: Scrape type for PU63843: 0
2026-03-28 12:11:08 [auto1.it] INFO: Found listing with ID: DW91233
2026-03-28 12:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:09 [auto1.it] INFO: Channel: 24h | Page: 84 | totalHits: 3676 | hits on page: 40
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: EA21012
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: SR85753
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR85753%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [auto1.it] INFO: Scrape type for SR85753: 0
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: LC41998
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: TZ26377
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ26377%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [auto1.it] INFO: Scrape type for TZ26377: 0
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: ZV75074
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV75074%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [auto1.it] INFO: Scrape type for ZV75074: 0
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: CP26264
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP26264%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [auto1.it] INFO: Scrape type for CP26264: 0
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: YT14284
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: XC32215
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC32215%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [auto1.it] INFO: Scrape type for XC32215: 0
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: YZ66981
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: GC55004
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: RL48638
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL48638%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [auto1.it] INFO: Scrape type for RL48638: 0
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: MZ97051
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MZ97051%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [auto1.it] INFO: Scrape type for MZ97051: 0
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: DV74338
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV74338%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [auto1.it] INFO: Scrape type for DV74338: 0
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: DA57942
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: RD83320
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD83320%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [auto1.it] INFO: Scrape type for RD83320: 0
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: FC73004
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC73004%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [auto1.it] INFO: Scrape type for FC73004: 0
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: UK76860
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK76860%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [auto1.it] INFO: Scrape type for UK76860: 0
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: XH07717
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH07717%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [auto1.it] INFO: Scrape type for XH07717: 0
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: FR80508
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR80508%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [auto1.it] INFO: Scrape type for FR80508: 0
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: ZT64017
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: CH37521
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH37521%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [auto1.it] INFO: Scrape type for CH37521: 0
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: JU23021
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: BD54797
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: CV42265
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV42265%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [auto1.it] INFO: Scrape type for CV42265: 0
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: VL10175
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: RB61179
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: TX50484
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TX50484%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [auto1.it] INFO: Scrape type for TX50484: 0
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: ST20254
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: UC27147
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: BV06574
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: TC65145
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TC65145%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [auto1.it] INFO: Scrape type for TC65145: 0
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: SG53706
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG53706%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [auto1.it] INFO: Scrape type for SG53706: 0
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: SM56678
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: BX57696
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: UK17345
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: ER04044
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ER04044%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [auto1.it] INFO: Scrape type for ER04044: 0
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: PG80369
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PG80369%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [auto1.it] INFO: Scrape type for PG80369: 0
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: ET07404
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: LD41720
2026-03-28 12:11:09 [auto1.it] INFO: Found listing with ID: YA87774
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA87774%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [auto1.it] INFO: Scrape type for YA87774: 0
2026-03-28 12:11:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:10 [auto1.it] INFO: Channel: 24h | Page: 85 | totalHits: 3677 | hits on page: 40
2026-03-28 12:11:10 [auto1.it] INFO: Found listing with ID: YA87774
2026-03-28 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA87774%27 HTTP/1.1" 200 None
2026-03-28 12:11:10 [auto1.it] INFO: Scrape type for YA87774: 0
2026-03-28 12:11:10 [auto1.it] INFO: Found listing with ID: MU61390
2026-03-28 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU61390%27 HTTP/1.1" 200 None
2026-03-28 12:11:10 [auto1.it] INFO: Scrape type for MU61390: 0
2026-03-28 12:11:10 [auto1.it] INFO: Found listing with ID: WH19380
2026-03-28 12:11:10 [auto1.it] INFO: Found listing with ID: YX87347
2026-03-28 12:11:10 [auto1.it] INFO: Found listing with ID: PA70519
2026-03-28 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA70519%27 HTTP/1.1" 200 None
2026-03-28 12:11:10 [auto1.it] INFO: Scrape type for PA70519: 0
2026-03-28 12:11:10 [auto1.it] INFO: Found listing with ID: SC05419
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC05419%27 HTTP/1.1" 200 None
2026-03-28 12:11:11 [auto1.it] INFO: Scrape type for SC05419: 0
2026-03-28 12:11:11 [auto1.it] INFO: Found listing with ID: EG89993
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG89993%27 HTTP/1.1" 200 None
2026-03-28 12:11:11 [auto1.it] INFO: Scrape type for EG89993: 0
2026-03-28 12:11:11 [auto1.it] INFO: Found listing with ID: TT44801
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT44801%27 HTTP/1.1" 200 None
2026-03-28 12:11:11 [auto1.it] INFO: Scrape type for TT44801: 0
2026-03-28 12:11:11 [auto1.it] INFO: Found listing with ID: BR85251
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR85251%27 HTTP/1.1" 200 None
2026-03-28 12:11:11 [auto1.it] INFO: Scrape type for BR85251: 0
2026-03-28 12:11:11 [auto1.it] INFO: Found listing with ID: ML20734
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML20734%27 HTTP/1.1" 200 None
2026-03-28 12:11:11 [auto1.it] INFO: Scrape type for ML20734: 0
2026-03-28 12:11:11 [auto1.it] INFO: Found listing with ID: ZZ56254
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ56254%27 HTTP/1.1" 200 None
2026-03-28 12:11:11 [auto1.it] INFO: Scrape type for ZZ56254: 0
2026-03-28 12:11:11 [auto1.it] INFO: Found listing with ID: CX56381
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CX56381%27 HTTP/1.1" 200 None
2026-03-28 12:11:11 [auto1.it] INFO: Scrape type for CX56381: 0
2026-03-28 12:11:11 [auto1.it] INFO: Found listing with ID: UG05722
2026-03-28 12:11:11 [auto1.it] INFO: Found listing with ID: ED77139
2026-03-28 12:11:11 [auto1.it] INFO: Found listing with ID: UX44191
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX44191%27 HTTP/1.1" 200 None
2026-03-28 12:11:11 [auto1.it] INFO: Scrape type for UX44191: 0
2026-03-28 12:11:11 [auto1.it] INFO: Found listing with ID: ZU39445
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU39445%27 HTTP/1.1" 200 None
2026-03-28 12:11:11 [auto1.it] INFO: Scrape type for ZU39445: 0
2026-03-28 12:11:11 [auto1.it] INFO: Found listing with ID: WM00919
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM00919%27 HTTP/1.1" 200 None
2026-03-28 12:11:11 [auto1.it] INFO: Scrape type for WM00919: 0
2026-03-28 12:11:11 [auto1.it] INFO: Found listing with ID: YU40333
2026-03-28 12:11:11 [auto1.it] INFO: Found listing with ID: XB00155
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XB00155%27 HTTP/1.1" 200 None
2026-03-28 12:11:11 [auto1.it] INFO: Scrape type for XB00155: 0
2026-03-28 12:11:11 [auto1.it] INFO: Found listing with ID: VY08559
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY08559%27 HTTP/1.1" 200 None
2026-03-28 12:11:11 [auto1.it] INFO: Scrape type for VY08559: 0
2026-03-28 12:11:11 [auto1.it] INFO: Found listing with ID: DT24064
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT24064%27 HTTP/1.1" 200 None
2026-03-28 12:11:11 [auto1.it] INFO: Scrape type for DT24064: 0
2026-03-28 12:11:11 [auto1.it] INFO: Found listing with ID: AF97148
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF97148%27 HTTP/1.1" 200 None
2026-03-28 12:11:11 [auto1.it] INFO: Scrape type for AF97148: 0
2026-03-28 12:11:11 [auto1.it] INFO: Found listing with ID: TK41328
2026-03-28 12:11:11 [auto1.it] INFO: Found listing with ID: EW75020
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW75020%27 HTTP/1.1" 200 None
2026-03-28 12:11:11 [auto1.it] INFO: Scrape type for EW75020: 0
2026-03-28 12:11:11 [auto1.it] INFO: Found listing with ID: XG00486
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XG00486%27 HTTP/1.1" 200 None
2026-03-28 12:11:11 [auto1.it] INFO: Scrape type for XG00486: 0
2026-03-28 12:11:11 [auto1.it] INFO: Found listing with ID: LZ05951
2026-03-28 12:11:11 [auto1.it] INFO: Found listing with ID: YU33914
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU33914%27 HTTP/1.1" 200 None
2026-03-28 12:11:11 [auto1.it] INFO: Scrape type for YU33914: 0
2026-03-28 12:11:11 [auto1.it] INFO: Found listing with ID: SN78206
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN78206%27 HTTP/1.1" 200 None
2026-03-28 12:11:11 [auto1.it] INFO: Scrape type for SN78206: 0
2026-03-28 12:11:11 [auto1.it] INFO: Found listing with ID: PH25620
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PH25620%27 HTTP/1.1" 200 None
2026-03-28 12:11:11 [auto1.it] INFO: Scrape type for PH25620: 0
2026-03-28 12:11:11 [auto1.it] INFO: Found listing with ID: RZ31848
2026-03-28 12:11:11 [auto1.it] INFO: Found listing with ID: DW68997
2026-03-28 12:11:11 [auto1.it] INFO: Found listing with ID: MH53431
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH53431%27 HTTP/1.1" 200 None
2026-03-28 12:11:11 [auto1.it] INFO: Scrape type for MH53431: 0
2026-03-28 12:11:11 [auto1.it] INFO: Found listing with ID: SF43415
2026-03-28 12:11:11 [auto1.it] INFO: Found listing with ID: RD96225
2026-03-28 12:11:11 [auto1.it] INFO: Found listing with ID: YF34065
2026-03-28 12:11:11 [auto1.it] INFO: Found listing with ID: RH67441
2026-03-28 12:11:11 [auto1.it] INFO: Found listing with ID: KV39692
2026-03-28 12:11:11 [auto1.it] INFO: Found listing with ID: XC56824
2026-03-28 12:11:11 [auto1.it] INFO: Found listing with ID: YG84271
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG84271%27 HTTP/1.1" 200 None
2026-03-28 12:11:11 [auto1.it] INFO: Scrape type for YG84271: 0
2026-03-28 12:11:11 [auto1.it] INFO: Found listing with ID: UY38032
2026-03-28 12:11:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:12 [auto1.it] INFO: Channel: 24h | Page: 86 | totalHits: 3677 | hits on page: 40
2026-03-28 12:11:12 [auto1.it] INFO: Found listing with ID: TT97007
2026-03-28 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT97007%27 HTTP/1.1" 200 None
2026-03-28 12:11:12 [auto1.it] INFO: Scrape type for TT97007: 2
2026-03-28 12:11:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3874efb1-bb3f-5568-ad23-d477a9327d48 with identifier: TT97007
2026-03-28 12:11:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3874efb1-bb3f-5568-ad23-d477a9327d48 with scrape type 2
2026-03-28 12:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3874efb1-bb3f-5568-ad23-d477a9327d48 with scrape type 2
2026-03-28 12:11:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3874efb1-bb3f-5568-ad23-d477a9327d48, identifier: TT97007
2026-03-28 12:11:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3874efb1-bb3f-5568-ad23-d477a9327d48 with identifier: TT97007
2026-03-28 12:11:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3874efb1-bb3f-5568-ad23-d477a9327d48 with identifier: TT97007
2026-03-28 12:11:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3874efb1-bb3f-5568-ad23-d477a9327d48 with identifier: TT97007 to the API
2026-03-28 12:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:40:33Z',
 'fuel_type': 'petrol',
 'id': '3874efb1-bb3f-5568-ad23-d477a9327d48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT97007',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 69187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-26',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2015}
2026-03-28 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT97007%27 HTTP/1.1" 200 None
2026-03-28 12:11:12 [auto1.it] INFO: Saving data for TT97007: {'auction_closing_time': 1774716033.0, 'created_time': 1774300287.435089, 'last_price_update_time': 1774699872.876282}
2026-03-28 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TT97007') HTTP/1.1" 204 0
2026-03-28 12:11:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:13 [auto1.it] INFO: Found listing with ID: UL45556
2026-03-28 12:11:13 [auto1.it] INFO: Found listing with ID: GT53480
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT53480%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [auto1.it] INFO: Scrape type for GT53480: 0
2026-03-28 12:11:13 [auto1.it] INFO: Found listing with ID: RL33082
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL33082%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [auto1.it] INFO: Scrape type for RL33082: 0
2026-03-28 12:11:13 [auto1.it] INFO: Found listing with ID: TG24306
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG24306%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [auto1.it] INFO: Scrape type for TG24306: 0
2026-03-28 12:11:13 [auto1.it] INFO: Found listing with ID: NE13837
2026-03-28 12:11:13 [auto1.it] INFO: Found listing with ID: LR71348
2026-03-28 12:11:13 [auto1.it] INFO: Found listing with ID: GW48563
2026-03-28 12:11:13 [auto1.it] INFO: Found listing with ID: FF22275
2026-03-28 12:11:13 [auto1.it] INFO: Found listing with ID: LX97199
2026-03-28 12:11:13 [auto1.it] INFO: Found listing with ID: DK51991
2026-03-28 12:11:13 [auto1.it] INFO: Found listing with ID: LY57551
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY57551%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [auto1.it] INFO: Scrape type for LY57551: 0
2026-03-28 12:11:13 [auto1.it] INFO: Found listing with ID: HE58096
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE58096%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [auto1.it] INFO: Scrape type for HE58096: 0
2026-03-28 12:11:13 [auto1.it] INFO: Found listing with ID: PN84990
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN84990%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [auto1.it] INFO: Scrape type for PN84990: 0
2026-03-28 12:11:13 [auto1.it] INFO: Found listing with ID: SM22245
2026-03-28 12:11:13 [auto1.it] INFO: Found listing with ID: EP08968
2026-03-28 12:11:13 [auto1.it] INFO: Found listing with ID: FB65897
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB65897%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [auto1.it] INFO: Scrape type for FB65897: 0
2026-03-28 12:11:13 [auto1.it] INFO: Found listing with ID: KF31033
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF31033%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [auto1.it] INFO: Scrape type for KF31033: 0
2026-03-28 12:11:13 [auto1.it] INFO: Found listing with ID: RA25408
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA25408%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [auto1.it] INFO: Scrape type for RA25408: 0
2026-03-28 12:11:13 [auto1.it] INFO: Found listing with ID: KG02437
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KG02437%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [auto1.it] INFO: Scrape type for KG02437: 2
2026-03-28 12:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a7a5c14-de96-5ec6-851f-85fa819dc6c9 with identifier: KG02437
2026-03-28 12:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a7a5c14-de96-5ec6-851f-85fa819dc6c9 with scrape type 2
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a7a5c14-de96-5ec6-851f-85fa819dc6c9 with scrape type 2
2026-03-28 12:11:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2a7a5c14-de96-5ec6-851f-85fa819dc6c9, identifier: KG02437
2026-03-28 12:11:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2a7a5c14-de96-5ec6-851f-85fa819dc6c9 with identifier: KG02437
2026-03-28 12:11:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2a7a5c14-de96-5ec6-851f-85fa819dc6c9 with identifier: KG02437
2026-03-28 12:11:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2a7a5c14-de96-5ec6-851f-85fa819dc6c9 with identifier: KG02437 to the API
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:23:35Z',
 'fuel_type': 'diesel',
 'id': '2a7a5c14-de96-5ec6-851f-85fa819dc6c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG02437',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 289367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-28',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KG02437%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [auto1.it] INFO: Saving data for KG02437: {'auction_closing_time': 1774715015.0, 'created_time': 1774300333.503374, 'last_price_update_time': 1774699873.581498}
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KG02437') HTTP/1.1" 204 0
2026-03-28 12:11:13 [auto1.it] INFO: Found listing with ID: DP78893
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP78893%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [auto1.it] INFO: Scrape type for DP78893: 0
2026-03-28 12:11:13 [auto1.it] INFO: Found listing with ID: UJ66117
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UJ66117%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [auto1.it] INFO: Scrape type for UJ66117: 0
2026-03-28 12:11:13 [auto1.it] INFO: Found listing with ID: BG99585
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG99585%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [auto1.it] INFO: Scrape type for BG99585: 0
2026-03-28 12:11:13 [auto1.it] INFO: Found listing with ID: XC65612
2026-03-28 12:11:13 [auto1.it] INFO: Found listing with ID: JR54731
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR54731%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [auto1.it] INFO: Scrape type for JR54731: 2
2026-03-28 12:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a015cec-2788-5d14-a58d-5313bd9503da with identifier: JR54731
2026-03-28 12:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a015cec-2788-5d14-a58d-5313bd9503da with scrape type 2
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a015cec-2788-5d14-a58d-5313bd9503da with scrape type 2
2026-03-28 12:11:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6a015cec-2788-5d14-a58d-5313bd9503da, identifier: JR54731
2026-03-28 12:11:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6a015cec-2788-5d14-a58d-5313bd9503da with identifier: JR54731
2026-03-28 12:11:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6a015cec-2788-5d14-a58d-5313bd9503da with identifier: JR54731
2026-03-28 12:11:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6a015cec-2788-5d14-a58d-5313bd9503da with identifier: JR54731 to the API
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:19:12Z',
 'fuel_type': 'diesel',
 'id': '6a015cec-2788-5d14-a58d-5313bd9503da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR54731',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 56403,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-27',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 CRDi Xtech ISG 2WD',
 'transmission': 'manual',
 'trim': 'Xtech ISG 2WD',
 'year': 2020}
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR54731%27 HTTP/1.1" 200 None
2026-03-28 12:11:14 [auto1.it] INFO: Saving data for JR54731: {'auction_closing_time': 1774714752.0, 'created_time': 1774300305.785766, 'last_price_update_time': 1774699874.136593}
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JR54731') HTTP/1.1" 204 0
2026-03-28 12:11:14 [auto1.it] INFO: Found listing with ID: JU83939
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU83939%27 HTTP/1.1" 200 None
2026-03-28 12:11:14 [auto1.it] INFO: Scrape type for JU83939: 0
2026-03-28 12:11:14 [auto1.it] INFO: Found listing with ID: WP21128
2026-03-28 12:11:14 [auto1.it] INFO: Found listing with ID: AL62204
2026-03-28 12:11:14 [auto1.it] INFO: Found listing with ID: SS09351
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS09351%27 HTTP/1.1" 200 None
2026-03-28 12:11:14 [auto1.it] INFO: Scrape type for SS09351: 0
2026-03-28 12:11:14 [auto1.it] INFO: Found listing with ID: TH21432
2026-03-28 12:11:14 [auto1.it] INFO: Found listing with ID: ZX88730
2026-03-28 12:11:14 [auto1.it] INFO: Found listing with ID: SK49323
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK49323%27 HTTP/1.1" 200 None
2026-03-28 12:11:14 [auto1.it] INFO: Scrape type for SK49323: 0
2026-03-28 12:11:14 [auto1.it] INFO: Found listing with ID: CJ66066
2026-03-28 12:11:14 [auto1.it] INFO: Found listing with ID: AK04319
2026-03-28 12:11:14 [auto1.it] INFO: Found listing with ID: LW29692
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW29692%27 HTTP/1.1" 200 None
2026-03-28 12:11:14 [auto1.it] INFO: Scrape type for LW29692: 0
2026-03-28 12:11:14 [auto1.it] INFO: Found listing with ID: PM88021
2026-03-28 12:11:14 [auto1.it] INFO: Found listing with ID: DB18786
2026-03-28 12:11:14 [auto1.it] INFO: Found listing with ID: DW69714
2026-03-28 12:11:14 [auto1.it] INFO: Found listing with ID: GB19602
2026-03-28 12:11:14 [auto1.it] INFO: Found listing with ID: JR93194
2026-03-28 12:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:15 [auto1.it] INFO: Channel: 24h | Page: 87 | totalHits: 3677 | hits on page: 40
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: CD59495
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: SV37675
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: JV83854
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: XJ39462
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ39462%27 HTTP/1.1" 200 None
2026-03-28 12:11:15 [auto1.it] INFO: Scrape type for XJ39462: 0
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: NB02604
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB02604%27 HTTP/1.1" 200 None
2026-03-28 12:11:15 [auto1.it] INFO: Scrape type for NB02604: 0
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: AZ52753
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: HS22715
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS22715%27 HTTP/1.1" 200 None
2026-03-28 12:11:15 [auto1.it] INFO: Scrape type for HS22715: 0
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: GB11317
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: WW83170
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: SL34558
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: DW35808
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW35808%27 HTTP/1.1" 200 None
2026-03-28 12:11:15 [auto1.it] INFO: Scrape type for DW35808: 0
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: RN99841
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN99841%27 HTTP/1.1" 200 None
2026-03-28 12:11:15 [auto1.it] INFO: Scrape type for RN99841: 0
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: ZX72389
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: VA41104
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: PW56521
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: LH59018
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH59018%27 HTTP/1.1" 200 None
2026-03-28 12:11:15 [auto1.it] INFO: Scrape type for LH59018: 0
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: AP47784
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP47784%27 HTTP/1.1" 200 None
2026-03-28 12:11:15 [auto1.it] INFO: Scrape type for AP47784: 0
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: MT68027
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: ZA31579
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: UX29999
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: JH67201
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: AL30811
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL30811%27 HTTP/1.1" 200 None
2026-03-28 12:11:15 [auto1.it] INFO: Scrape type for AL30811: 0
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: TT50547
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: JY70774
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JY70774%27 HTTP/1.1" 200 None
2026-03-28 12:11:15 [auto1.it] INFO: Scrape type for JY70774: 0
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: MX32120
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: WW01067
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW01067%27 HTTP/1.1" 200 None
2026-03-28 12:11:15 [auto1.it] INFO: Scrape type for WW01067: 0
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: CN60691
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN60691%27 HTTP/1.1" 200 None
2026-03-28 12:11:15 [auto1.it] INFO: Scrape type for CN60691: 0
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: BR31309
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR31309%27 HTTP/1.1" 200 None
2026-03-28 12:11:15 [auto1.it] INFO: Scrape type for BR31309: 0
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: DC03945
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC03945%27 HTTP/1.1" 200 None
2026-03-28 12:11:15 [auto1.it] INFO: Scrape type for DC03945: 0
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: AY12786
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: TB60435
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB60435%27 HTTP/1.1" 200 None
2026-03-28 12:11:15 [auto1.it] INFO: Scrape type for TB60435: 0
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: ZA78643
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: VC37401
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC37401%27 HTTP/1.1" 200 None
2026-03-28 12:11:15 [auto1.it] INFO: Scrape type for VC37401: 0
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: AW98600
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: MS98879
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: GZ29519
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ29519%27 HTTP/1.1" 200 None
2026-03-28 12:11:15 [auto1.it] INFO: Scrape type for GZ29519: 0
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: NJ63404
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NJ63404%27 HTTP/1.1" 200 None
2026-03-28 12:11:15 [auto1.it] INFO: Scrape type for NJ63404: 0
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: UW94573
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: VG76075
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG76075%27 HTTP/1.1" 200 None
2026-03-28 12:11:15 [auto1.it] INFO: Scrape type for VG76075: 0
2026-03-28 12:11:15 [auto1.it] INFO: Found listing with ID: ZG86392
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZG86392%27 HTTP/1.1" 200 None
2026-03-28 12:11:15 [auto1.it] INFO: Scrape type for ZG86392: 0
2026-03-28 12:11:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:16 [auto1.it] INFO: Channel: 24h | Page: 88 | totalHits: 3677 | hits on page: 40
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: DP39396
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: EB44431
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: KM03539
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: RE99850
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE99850%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.it] INFO: Scrape type for RE99850: 0
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: SK80279
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK80279%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.it] INFO: Scrape type for SK80279: 0
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: US69373
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: NC67394
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC67394%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.it] INFO: Scrape type for NC67394: 0
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: JF90456
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: JC41210
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: HW82018
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW82018%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.it] INFO: Scrape type for HW82018: 0
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: VY08024
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY08024%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.it] INFO: Scrape type for VY08024: 0
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: AE09913
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AE09913%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.it] INFO: Scrape type for AE09913: 0
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: ST64226
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: TH88339
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH88339%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.it] INFO: Scrape type for TH88339: 0
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: XJ18858
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ18858%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.it] INFO: Scrape type for XJ18858: 0
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: NM56587
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: NF96122
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF96122%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.it] INFO: Scrape type for NF96122: 0
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: SX04553
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: LB78915
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: NC00198
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: GA39078
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA39078%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.it] INFO: Scrape type for GA39078: 0
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: JP92326
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP92326%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.it] INFO: Scrape type for JP92326: 0
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: NC97185
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: MJ97902
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ97902%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.it] INFO: Scrape type for MJ97902: 0
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: NV87278
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: EM60693
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: XH17321
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH17321%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.it] INFO: Scrape type for XH17321: 0
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: ES59878
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: SK90576
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK90576%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.it] INFO: Scrape type for SK90576: 0
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: SX21241
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: FF76752
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF76752%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.it] INFO: Scrape type for FF76752: 0
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: MG44195
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: WY95771
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY95771%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.it] INFO: Scrape type for WY95771: 0
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: GN63834
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: PA53057
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA53057%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.it] INFO: Scrape type for PA53057: 0
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: TL40655
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL40655%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.it] INFO: Scrape type for TL40655: 0
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: VX86460
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: LX42454
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: HK70439
2026-03-28 12:11:16 [auto1.it] INFO: Found listing with ID: ER51817
2026-03-28 12:11:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:18 [auto1.it] INFO: Channel: 24h | Page: 89 | totalHits: 3677 | hits on page: 40
2026-03-28 12:11:18 [auto1.it] INFO: Found listing with ID: CA07197
2026-03-28 12:11:18 [auto1.it] INFO: Found listing with ID: TJ19111
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ19111%27 HTTP/1.1" 200 None
2026-03-28 12:11:18 [auto1.it] INFO: Scrape type for TJ19111: 0
2026-03-28 12:11:18 [auto1.it] INFO: Found listing with ID: XX93100
2026-03-28 12:11:18 [auto1.it] INFO: Found listing with ID: MR16221
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR16221%27 HTTP/1.1" 200 None
2026-03-28 12:11:18 [auto1.it] INFO: Scrape type for MR16221: 0
2026-03-28 12:11:18 [auto1.it] INFO: Found listing with ID: YP04797
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YP04797%27 HTTP/1.1" 200 None
2026-03-28 12:11:18 [auto1.it] INFO: Scrape type for YP04797: 0
2026-03-28 12:11:18 [auto1.it] INFO: Found listing with ID: DE48831
2026-03-28 12:11:18 [auto1.it] INFO: Found listing with ID: LS49318
2026-03-28 12:11:18 [auto1.it] INFO: Found listing with ID: ZW56281
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW56281%27 HTTP/1.1" 200 None
2026-03-28 12:11:18 [auto1.it] INFO: Scrape type for ZW56281: 0
2026-03-28 12:11:18 [auto1.it] INFO: Found listing with ID: ET21203
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET21203%27 HTTP/1.1" 200 None
2026-03-28 12:11:18 [auto1.it] INFO: Scrape type for ET21203: 0
2026-03-28 12:11:18 [auto1.it] INFO: Found listing with ID: SV89112
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV89112%27 HTTP/1.1" 200 None
2026-03-28 12:11:18 [auto1.it] INFO: Scrape type for SV89112: 0
2026-03-28 12:11:18 [auto1.it] INFO: Found listing with ID: ZL07806
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL07806%27 HTTP/1.1" 200 None
2026-03-28 12:11:18 [auto1.it] INFO: Scrape type for ZL07806: 0
2026-03-28 12:11:18 [auto1.it] INFO: Found listing with ID: WH83035
2026-03-28 12:11:18 [auto1.it] INFO: Found listing with ID: XX96776
2026-03-28 12:11:18 [auto1.it] INFO: Found listing with ID: VV97216
2026-03-28 12:11:18 [auto1.it] INFO: Found listing with ID: DP87516
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP87516%27 HTTP/1.1" 200 None
2026-03-28 12:11:18 [auto1.it] INFO: Scrape type for DP87516: 2
2026-03-28 12:11:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e67f9678-e068-556b-9236-a6a230f6aee6 with identifier: DP87516
2026-03-28 12:11:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e67f9678-e068-556b-9236-a6a230f6aee6 with scrape type 2
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e67f9678-e068-556b-9236-a6a230f6aee6 with scrape type 2
2026-03-28 12:11:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e67f9678-e068-556b-9236-a6a230f6aee6, identifier: DP87516
2026-03-28 12:11:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e67f9678-e068-556b-9236-a6a230f6aee6 with identifier: DP87516
2026-03-28 12:11:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e67f9678-e068-556b-9236-a6a230f6aee6 with identifier: DP87516
2026-03-28 12:11:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e67f9678-e068-556b-9236-a6a230f6aee6 with identifier: DP87516 to the API
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:22:35Z',
 'fuel_type': 'petrol',
 'id': 'e67f9678-e068-556b-9236-a6a230f6aee6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP87516',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 103710,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-20',
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.2 Silver',
 'transmission': 'manual',
 'trim': 'Silver',
 'year': 2016}
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP87516%27 HTTP/1.1" 200 None
2026-03-28 12:11:18 [auto1.it] INFO: Saving data for DP87516: {'auction_closing_time': 1774714955.0, 'created_time': 1774300216.632855, 'last_price_update_time': 1774699878.705317}
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DP87516') HTTP/1.1" 204 0
2026-03-28 12:11:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:18 [auto1.it] INFO: Found listing with ID: FF48098
2026-03-28 12:11:18 [auto1.it] INFO: Found listing with ID: GV75261
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV75261%27 HTTP/1.1" 200 None
2026-03-28 12:11:18 [auto1.it] INFO: Scrape type for GV75261: 0
2026-03-28 12:11:18 [auto1.it] INFO: Found listing with ID: TV74767
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TV74767%27 HTTP/1.1" 200 None
2026-03-28 12:11:18 [auto1.it] INFO: Scrape type for TV74767: 0
2026-03-28 12:11:18 [auto1.it] INFO: Found listing with ID: YW82008
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW82008%27 HTTP/1.1" 200 None
2026-03-28 12:11:18 [auto1.it] INFO: Scrape type for YW82008: 0
2026-03-28 12:11:18 [auto1.it] INFO: Found listing with ID: KD02463
2026-03-28 12:11:18 [auto1.it] INFO: Found listing with ID: RT31033
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT31033%27 HTTP/1.1" 200 None
2026-03-28 12:11:18 [auto1.it] INFO: Scrape type for RT31033: 0
2026-03-28 12:11:18 [auto1.it] INFO: Found listing with ID: KW23650
2026-03-28 12:11:18 [auto1.it] INFO: Found listing with ID: DW12322
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW12322%27 HTTP/1.1" 200 None
2026-03-28 12:11:18 [auto1.it] INFO: Scrape type for DW12322: 0
2026-03-28 12:11:18 [auto1.it] INFO: Found listing with ID: HL13838
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HL13838%27 HTTP/1.1" 200 None
2026-03-28 12:11:18 [auto1.it] INFO: Scrape type for HL13838: 0
2026-03-28 12:11:18 [auto1.it] INFO: Found listing with ID: KS49913
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KS49913%27 HTTP/1.1" 200 None
2026-03-28 12:11:18 [auto1.it] INFO: Scrape type for KS49913: 0
2026-03-28 12:11:18 [auto1.it] INFO: Found listing with ID: BT22959
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT22959%27 HTTP/1.1" 200 None
2026-03-28 12:11:18 [auto1.it] INFO: Scrape type for BT22959: 0
2026-03-28 12:11:18 [auto1.it] INFO: Found listing with ID: MN59888
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN59888%27 HTTP/1.1" 200 None
2026-03-28 12:11:18 [auto1.it] INFO: Scrape type for MN59888: 0
2026-03-28 12:11:18 [auto1.it] INFO: Found listing with ID: FW35723
2026-03-28 12:11:18 [auto1.it] INFO: Found listing with ID: KR27714
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR27714%27 HTTP/1.1" 200 None
2026-03-28 12:11:19 [auto1.it] INFO: Scrape type for KR27714: 0
2026-03-28 12:11:19 [auto1.it] INFO: Found listing with ID: ED22447
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED22447%27 HTTP/1.1" 200 None
2026-03-28 12:11:19 [auto1.it] INFO: Scrape type for ED22447: 2
2026-03-28 12:11:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a43ab03-acdd-53c9-a289-8dc935b07a60 with identifier: ED22447
2026-03-28 12:11:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a43ab03-acdd-53c9-a289-8dc935b07a60 with scrape type 2
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a43ab03-acdd-53c9-a289-8dc935b07a60 with scrape type 2
2026-03-28 12:11:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9a43ab03-acdd-53c9-a289-8dc935b07a60, identifier: ED22447
2026-03-28 12:11:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9a43ab03-acdd-53c9-a289-8dc935b07a60 with identifier: ED22447
2026-03-28 12:11:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9a43ab03-acdd-53c9-a289-8dc935b07a60 with identifier: ED22447
2026-03-28 12:11:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9a43ab03-acdd-53c9-a289-8dc935b07a60 with identifier: ED22447 to the API
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:51:16Z',
 'fuel_type': 'diesel',
 'id': '9a43ab03-acdd-53c9-a289-8dc935b07a60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED22447',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 111851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-27',
 'seller_name': None,
 'title': 'Audi Q5 40 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED22447%27 HTTP/1.1" 200 None
2026-03-28 12:11:19 [auto1.it] INFO: Saving data for ED22447: {'auction_closing_time': 1774716676.0, 'created_time': 1774343165.331347, 'last_price_update_time': 1774699879.418078}
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ED22447') HTTP/1.1" 204 0
2026-03-28 12:11:19 [auto1.it] INFO: Found listing with ID: VJ79188
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ79188%27 HTTP/1.1" 200 None
2026-03-28 12:11:19 [auto1.it] INFO: Scrape type for VJ79188: 0
2026-03-28 12:11:19 [auto1.it] INFO: Found listing with ID: LU63689
2026-03-28 12:11:19 [auto1.it] INFO: Found listing with ID: WV37243
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV37243%27 HTTP/1.1" 200 None
2026-03-28 12:11:19 [auto1.it] INFO: Scrape type for WV37243: 0
2026-03-28 12:11:19 [auto1.it] INFO: Found listing with ID: JB13262
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB13262%27 HTTP/1.1" 200 None
2026-03-28 12:11:19 [auto1.it] INFO: Scrape type for JB13262: 0
2026-03-28 12:11:19 [auto1.it] INFO: Found listing with ID: CC61798
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC61798%27 HTTP/1.1" 200 None
2026-03-28 12:11:19 [auto1.it] INFO: Scrape type for CC61798: 0
2026-03-28 12:11:19 [auto1.it] INFO: Found listing with ID: WD34729
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD34729%27 HTTP/1.1" 200 None
2026-03-28 12:11:19 [auto1.it] INFO: Scrape type for WD34729: 0
2026-03-28 12:11:19 [auto1.it] INFO: Found listing with ID: XH41983
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH41983%27 HTTP/1.1" 200 None
2026-03-28 12:11:19 [auto1.it] INFO: Scrape type for XH41983: 0
2026-03-28 12:11:19 [auto1.it] INFO: Found listing with ID: ZW84587
2026-03-28 12:11:19 [auto1.it] INFO: Found listing with ID: LN05453
2026-03-28 12:11:19 [auto1.it] INFO: Found listing with ID: RT93241
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT93241%27 HTTP/1.1" 200 None
2026-03-28 12:11:19 [auto1.it] INFO: Scrape type for RT93241: 0
2026-03-28 12:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:20 [auto1.it] INFO: Channel: 24h | Page: 90 | totalHits: 3677 | hits on page: 40
2026-03-28 12:11:20 [auto1.it] INFO: Found listing with ID: RY04213
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY04213%27 HTTP/1.1" 200 None
2026-03-28 12:11:20 [auto1.it] INFO: Scrape type for RY04213: 0
2026-03-28 12:11:20 [auto1.it] INFO: Found listing with ID: ER90508
2026-03-28 12:11:20 [auto1.it] INFO: Found listing with ID: HZ93936
2026-03-28 12:11:20 [auto1.it] INFO: Found listing with ID: NF97325
2026-03-28 12:11:20 [auto1.it] INFO: Found listing with ID: JE32335
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE32335%27 HTTP/1.1" 200 None
2026-03-28 12:11:20 [auto1.it] INFO: Scrape type for JE32335: 0
2026-03-28 12:11:20 [auto1.it] INFO: Found listing with ID: BJ63933
2026-03-28 12:11:20 [auto1.it] INFO: Found listing with ID: LR54413
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR54413%27 HTTP/1.1" 200 None
2026-03-28 12:11:20 [auto1.it] INFO: Scrape type for LR54413: 0
2026-03-28 12:11:20 [auto1.it] INFO: Found listing with ID: XN19179
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN19179%27 HTTP/1.1" 200 None
2026-03-28 12:11:20 [auto1.it] INFO: Scrape type for XN19179: 0
2026-03-28 12:11:20 [auto1.it] INFO: Found listing with ID: EZ73351
2026-03-28 12:11:20 [auto1.it] INFO: Found listing with ID: SB88786
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB88786%27 HTTP/1.1" 200 None
2026-03-28 12:11:20 [auto1.it] INFO: Scrape type for SB88786: 0
2026-03-28 12:11:20 [auto1.it] INFO: Found listing with ID: HE93915
2026-03-28 12:11:20 [auto1.it] INFO: Found listing with ID: ED09945
2026-03-28 12:11:20 [auto1.it] INFO: Found listing with ID: HA74709
2026-03-28 12:11:20 [auto1.it] INFO: Found listing with ID: XJ87572
2026-03-28 12:11:20 [auto1.it] INFO: Found listing with ID: FZ12921
2026-03-28 12:11:20 [auto1.it] INFO: Found listing with ID: SE27388
2026-03-28 12:11:20 [auto1.it] INFO: Found listing with ID: JS62412
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS62412%27 HTTP/1.1" 200 None
2026-03-28 12:11:20 [auto1.it] INFO: Scrape type for JS62412: 0
2026-03-28 12:11:20 [auto1.it] INFO: Found listing with ID: ZV11200
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV11200%27 HTTP/1.1" 200 None
2026-03-28 12:11:20 [auto1.it] INFO: Scrape type for ZV11200: 0
2026-03-28 12:11:20 [auto1.it] INFO: Found listing with ID: ZZ46834
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ46834%27 HTTP/1.1" 200 None
2026-03-28 12:11:20 [auto1.it] INFO: Scrape type for ZZ46834: 0
2026-03-28 12:11:20 [auto1.it] INFO: Found listing with ID: HR66434
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR66434%27 HTTP/1.1" 200 None
2026-03-28 12:11:20 [auto1.it] INFO: Scrape type for HR66434: 0
2026-03-28 12:11:20 [auto1.it] INFO: Found listing with ID: ZK25944
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK25944%27 HTTP/1.1" 200 None
2026-03-28 12:11:20 [auto1.it] INFO: Scrape type for ZK25944: 0
2026-03-28 12:11:20 [auto1.it] INFO: Found listing with ID: SM34278
2026-03-28 12:11:20 [auto1.it] INFO: Found listing with ID: EU08042
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU08042%27 HTTP/1.1" 200 None
2026-03-28 12:11:20 [auto1.it] INFO: Scrape type for EU08042: 0
2026-03-28 12:11:20 [auto1.it] INFO: Found listing with ID: LC36038
2026-03-28 12:11:20 [auto1.it] INFO: Found listing with ID: RJ82738
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ82738%27 HTTP/1.1" 200 None
2026-03-28 12:11:20 [auto1.it] INFO: Scrape type for RJ82738: 0
2026-03-28 12:11:20 [auto1.it] INFO: Found listing with ID: UR83709
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR83709%27 HTTP/1.1" 200 None
2026-03-28 12:11:20 [auto1.it] INFO: Scrape type for UR83709: 2
2026-03-28 12:11:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d38515d-5a51-5bea-95de-680e37dd2f12 with identifier: UR83709
2026-03-28 12:11:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d38515d-5a51-5bea-95de-680e37dd2f12 with scrape type 2
2026-03-28 12:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d38515d-5a51-5bea-95de-680e37dd2f12 with scrape type 2
2026-03-28 12:11:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5d38515d-5a51-5bea-95de-680e37dd2f12, identifier: UR83709
2026-03-28 12:11:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5d38515d-5a51-5bea-95de-680e37dd2f12 with identifier: UR83709
2026-03-28 12:11:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5d38515d-5a51-5bea-95de-680e37dd2f12 with identifier: UR83709
2026-03-28 12:11:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5d38515d-5a51-5bea-95de-680e37dd2f12 with identifier: UR83709 to the API
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-28T16:53:57Z',
 'fuel_type': 'petrol',
 'id': '5d38515d-5a51-5bea-95de-680e37dd2f12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR83709',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 94742,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-11',
 'seller_name': None,
 'title': 'MINI Countryman One',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR83709%27 HTTP/1.1" 200 None
2026-03-28 12:11:21 [auto1.it] INFO: Saving data for UR83709: {'auction_closing_time': 1774716837.0, 'created_time': 1774516024.184493, 'last_price_update_time': 1774699881.093028}
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UR83709') HTTP/1.1" 204 0
2026-03-28 12:11:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:21 [auto1.it] INFO: Found listing with ID: KM71175
2026-03-28 12:11:21 [auto1.it] INFO: Found listing with ID: ZP73975
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP73975%27 HTTP/1.1" 200 None
2026-03-28 12:11:21 [auto1.it] INFO: Scrape type for ZP73975: 0
2026-03-28 12:11:21 [auto1.it] INFO: Found listing with ID: LX64348
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX64348%27 HTTP/1.1" 200 None
2026-03-28 12:11:21 [auto1.it] INFO: Scrape type for LX64348: 0
2026-03-28 12:11:21 [auto1.it] INFO: Found listing with ID: RY42018
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY42018%27 HTTP/1.1" 200 None
2026-03-28 12:11:21 [auto1.it] INFO: Scrape type for RY42018: 0
2026-03-28 12:11:21 [auto1.it] INFO: Found listing with ID: MX61025
2026-03-28 12:11:21 [auto1.it] INFO: Found listing with ID: UL18238
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL18238%27 HTTP/1.1" 200 None
2026-03-28 12:11:21 [auto1.it] INFO: Scrape type for UL18238: 0
2026-03-28 12:11:21 [auto1.it] INFO: Found listing with ID: UA98347
2026-03-28 12:11:21 [auto1.it] INFO: Found listing with ID: MA06356
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA06356%27 HTTP/1.1" 200 None
2026-03-28 12:11:21 [auto1.it] INFO: Scrape type for MA06356: 0
2026-03-28 12:11:21 [auto1.it] INFO: Found listing with ID: XW51036
2026-03-28 12:11:21 [auto1.it] INFO: Found listing with ID: VX82839
2026-03-28 12:11:21 [auto1.it] INFO: Found listing with ID: BJ69368
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ69368%27 HTTP/1.1" 200 None
2026-03-28 12:11:21 [auto1.it] INFO: Scrape type for BJ69368: 0
2026-03-28 12:11:21 [auto1.it] INFO: Found listing with ID: DT48918
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT48918%27 HTTP/1.1" 200 None
2026-03-28 12:11:21 [auto1.it] INFO: Scrape type for DT48918: 0
2026-03-28 12:11:21 [auto1.it] INFO: Found listing with ID: VL74139
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VL74139%27 HTTP/1.1" 200 None
2026-03-28 12:11:21 [auto1.it] INFO: Scrape type for VL74139: 0
2026-03-28 12:11:21 [auto1.it] INFO: Found listing with ID: NN68396
2026-03-28 12:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:22 [auto1.it] INFO: Channel: 24h | Page: 91 | totalHits: 3677 | hits on page: 40
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: BW07837
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW07837%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.it] INFO: Scrape type for BW07837: 0
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: GL09473
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: CN54432
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: AS27324
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: WD12881
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD12881%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.it] INFO: Scrape type for WD12881: 0
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: XP84134
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP84134%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.it] INFO: Scrape type for XP84134: 0
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: DX59233
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: US24028
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US24028%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.it] INFO: Scrape type for US24028: 0
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: UX21158
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: GX75357
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX75357%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.it] INFO: Scrape type for GX75357: 0
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: AR78219
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: DA37611
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: LD48805
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD48805%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.it] INFO: Scrape type for LD48805: 0
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: RA37062
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: XX59557
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: CJ01668
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CJ01668%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.it] INFO: Scrape type for CJ01668: 0
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: ED34625
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: NY40947
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY40947%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.it] INFO: Scrape type for NY40947: 0
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: EB11724
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EB11724%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.it] INFO: Scrape type for EB11724: 0
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: BP64052
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: TJ20772
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ20772%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.it] INFO: Scrape type for TJ20772: 0
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: RS54948
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS54948%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.it] INFO: Scrape type for RS54948: 0
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: MA83267
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: KR95959
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: DT34666
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: WR61044
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR61044%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.it] INFO: Scrape type for WR61044: 0
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: PN56075
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: JN19530
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN19530%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.it] INFO: Scrape type for JN19530: 0
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: CP99007
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: ES67961
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: YY37168
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY37168%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.it] INFO: Scrape type for YY37168: 0
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: VC26054
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: ZN14128
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN14128%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.it] INFO: Scrape type for ZN14128: 0
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: EV19228
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV19228%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.it] INFO: Scrape type for EV19228: 0
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: RM88416
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM88416%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.it] INFO: Scrape type for RM88416: 0
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: XV39349
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV39349%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.it] INFO: Scrape type for XV39349: 0
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: KA77498
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: CN88471
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: HY34989
2026-03-28 12:11:22 [auto1.it] INFO: Found listing with ID: EN53386
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN53386%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.it] INFO: Scrape type for EN53386: 0
2026-03-28 12:11:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:23 [auto1.it] INFO: Channel: 24h | Page: 92 | totalHits: 3677 | hits on page: 37
2026-03-28 12:11:23 [auto1.it] INFO: Found listing with ID: CV81447
2026-03-28 12:11:23 [auto1.it] INFO: Found listing with ID: JU21728
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU21728%27 HTTP/1.1" 200 None
2026-03-28 12:11:23 [auto1.it] INFO: Scrape type for JU21728: 0
2026-03-28 12:11:23 [auto1.it] INFO: Found listing with ID: RG06778
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG06778%27 HTTP/1.1" 200 None
2026-03-28 12:11:24 [auto1.it] INFO: Scrape type for RG06778: 0
2026-03-28 12:11:24 [auto1.it] INFO: Found listing with ID: YW53472
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW53472%27 HTTP/1.1" 200 None
2026-03-28 12:11:24 [auto1.it] INFO: Scrape type for YW53472: 0
2026-03-28 12:11:24 [auto1.it] INFO: Found listing with ID: GM11383
2026-03-28 12:11:24 [auto1.it] INFO: Found listing with ID: LU21739
2026-03-28 12:11:24 [auto1.it] INFO: Found listing with ID: VS54724
2026-03-28 12:11:24 [auto1.it] INFO: Found listing with ID: KD87590
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD87590%27 HTTP/1.1" 200 None
2026-03-28 12:11:24 [auto1.it] INFO: Scrape type for KD87590: 0
2026-03-28 12:11:24 [auto1.it] INFO: Found listing with ID: TD38619
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD38619%27 HTTP/1.1" 200 None
2026-03-28 12:11:24 [auto1.it] INFO: Scrape type for TD38619: 0
2026-03-28 12:11:24 [auto1.it] INFO: Found listing with ID: XC14615
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC14615%27 HTTP/1.1" 200 None
2026-03-28 12:11:24 [auto1.it] INFO: Scrape type for XC14615: 0
2026-03-28 12:11:24 [auto1.it] INFO: Found listing with ID: TH24600
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH24600%27 HTTP/1.1" 200 None
2026-03-28 12:11:24 [auto1.it] INFO: Scrape type for TH24600: 0
2026-03-28 12:11:24 [auto1.it] INFO: Found listing with ID: PV59173
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV59173%27 HTTP/1.1" 200 None
2026-03-28 12:11:24 [auto1.it] INFO: Scrape type for PV59173: 0
2026-03-28 12:11:24 [auto1.it] INFO: Found listing with ID: GU05332
2026-03-28 12:11:24 [auto1.it] INFO: Found listing with ID: KY69981
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KY69981%27 HTTP/1.1" 200 None
2026-03-28 12:11:24 [auto1.it] INFO: Scrape type for KY69981: 0
2026-03-28 12:11:24 [auto1.it] INFO: Found listing with ID: GW90153
2026-03-28 12:11:24 [auto1.it] INFO: Found listing with ID: KC73163
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC73163%27 HTTP/1.1" 200 None
2026-03-28 12:11:24 [auto1.it] INFO: Scrape type for KC73163: 0
2026-03-28 12:11:24 [auto1.it] INFO: Found listing with ID: GC28590
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC28590%27 HTTP/1.1" 200 None
2026-03-28 12:11:24 [auto1.it] INFO: Scrape type for GC28590: 0
2026-03-28 12:11:24 [auto1.it] INFO: Found listing with ID: LH97251
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH97251%27 HTTP/1.1" 200 None
2026-03-28 12:11:24 [auto1.it] INFO: Scrape type for LH97251: 0
2026-03-28 12:11:24 [auto1.it] INFO: Found listing with ID: ND06570
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ND06570%27 HTTP/1.1" 200 None
2026-03-28 12:11:24 [auto1.it] INFO: Scrape type for ND06570: 0
2026-03-28 12:11:24 [auto1.it] INFO: Found listing with ID: FT76605
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT76605%27 HTTP/1.1" 200 None
2026-03-28 12:11:24 [auto1.it] INFO: Scrape type for FT76605: 0
2026-03-28 12:11:24 [auto1.it] INFO: Found listing with ID: UT43750
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT43750%27 HTTP/1.1" 200 None
2026-03-28 12:11:24 [auto1.it] INFO: Scrape type for UT43750: 0
2026-03-28 12:11:24 [auto1.it] INFO: Found listing with ID: TZ23741
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ23741%27 HTTP/1.1" 200 None
2026-03-28 12:11:24 [auto1.it] INFO: Scrape type for TZ23741: 0
2026-03-28 12:11:24 [auto1.it] INFO: Found listing with ID: VR70375
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VR70375%27 HTTP/1.1" 200 None
2026-03-28 12:11:24 [auto1.it] INFO: Scrape type for VR70375: 0
2026-03-28 12:11:24 [auto1.it] INFO: Found listing with ID: RR03246
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR03246%27 HTTP/1.1" 200 None
2026-03-28 12:11:24 [auto1.it] INFO: Scrape type for RR03246: 0
2026-03-28 12:11:24 [auto1.it] INFO: Found listing with ID: ZM66429
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM66429%27 HTTP/1.1" 200 None
2026-03-28 12:11:24 [auto1.it] INFO: Scrape type for ZM66429: 0
2026-03-28 12:11:24 [auto1.it] INFO: Found listing with ID: MS79311
2026-03-28 12:11:24 [auto1.it] INFO: Found listing with ID: YL87875
2026-03-28 12:11:24 [auto1.it] INFO: Found listing with ID: RJ76809
2026-03-28 12:11:24 [auto1.it] INFO: Found listing with ID: UU69652
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU69652%27 HTTP/1.1" 200 None
2026-03-28 12:11:24 [auto1.it] INFO: Scrape type for UU69652: 0
2026-03-28 12:11:24 [auto1.it] INFO: Found listing with ID: BH88586
2026-03-28 12:11:24 [auto1.it] INFO: Found listing with ID: PL71131
2026-03-28 12:11:24 [auto1.it] INFO: Found listing with ID: SL84548
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SL84548%27 HTTP/1.1" 200 None
2026-03-28 12:11:24 [auto1.it] INFO: Scrape type for SL84548: 0
2026-03-28 12:11:24 [auto1.it] INFO: Found listing with ID: NV14531
2026-03-28 12:11:24 [auto1.it] INFO: Found listing with ID: GA45330
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA45330%27 HTTP/1.1" 200 None
2026-03-28 12:11:24 [auto1.it] INFO: Scrape type for GA45330: 0
2026-03-28 12:11:24 [auto1.it] INFO: Found listing with ID: FG22478
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG22478%27 HTTP/1.1" 200 None
2026-03-28 12:11:24 [auto1.it] INFO: Scrape type for FG22478: 0
2026-03-28 12:11:24 [auto1.it] INFO: Found listing with ID: PK65337
2026-03-28 12:11:24 [auto1.it] INFO: Found listing with ID: AU70551
2026-03-28 12:11:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:25 [auto1.it] INFO: Channel: 24h | Page: 93 | totalHits: 3677 | hits on page: 0
2026-03-28 12:11:25 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-28 12:11:25 [auto1.it] INFO: auto1.it Batch config: batch 2/2
2026-03-28 12:11:25 [auto1.it] INFO: auto1.it Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 50, <ScrapeType.BATCH_SKIPPED: 5>: 41}
2026-03-28 12:11:25 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (362 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.it/task_23_2026-03-28T12_05_00.jl
2026-03-28 12:11:25 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 1597588,
 'downloader/request_count': 900,
 'downloader/request_method_count/GET': 805,
 'downloader/request_method_count/POST': 95,
 'downloader/response_bytes': 444751221,
 'downloader/response_count': 900,
 'downloader/response_status_count/200': 900,
 'dupefilter/filtered': 9,
 'elapsed_time_seconds': 380.314206,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 28, 12, 11, 25, 515848, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 362,
 'log_count/DEBUG': 11831,
 'log_count/INFO': 13277,
 'memusage/max': 210653184,
 'memusage/startup': 149889024,
 'photo_download_count': 611,
 'request_depth_max': 96,
 'response_received_count': 289,
 'scheduler/dequeued': 900,
 'scheduler/dequeued/memory': 900,
 'scheduler/enqueued': 900,
 'scheduler/enqueued/memory': 900,
 'scrape_type/batch_skipped': 1834,
 'scrape_type/new': 96,
 'scrape_type/price_update': 266,
 'scrape_type/skipped': 1512,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 289,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 2.434679164638208,
 'scrapy-zyte-api/mean_response_seconds': 2.486849519111553,
 'scrapy-zyte-api/processed': 289,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 289,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 288,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 289,
 'scrapy-zyte-api/request_args/httpRequestBody': 95,
 'scrapy-zyte-api/request_args/httpRequestMethod': 95,
 'scrapy-zyte-api/request_args/httpResponseBody': 289,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 289,
 'scrapy-zyte-api/request_args/sessionContext': 289,
 'scrapy-zyte-api/request_args/url': 289,
 'scrapy-zyte-api/status_codes/200': 289,
 'scrapy-zyte-api/success': 289,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 3717,
 'source/total_available': 3677,
 'start_time': datetime.datetime(2026, 3, 28, 12, 5, 5, 201642, tzinfo=datetime.timezone.utc)}
2026-03-28 12:11:25 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-28 12:11:25 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f04bf061090>
2026-03-28 12:11:25 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f04bef06810>